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Method and Apparatus for Non-Speculative Pre-Fetch Operation in Data 

Packet Processing 

5 

Field of the Invention 

The present invention is in the field of digital processing and pertains to 
10 apparatus and methods for processing packets in routers for packet networks, and 
more particularly to apparatus and methods for enabling a non-speculative pre-fetch 
operation associated with fetching processing instruction during packet processing. 

Cross-Reference to Related Documents 

15 

The present invention is a continuation in part (CIP) to a U.S. patent 
application S/N 09/737,375 entitled "Queuing System for Processors in Packet 
Routing Operations* 9 and filed on 12/14/00, which is included herein in it's entirety 
by reference. In addition, S/N 09/737,375 claims priority benefit under 35 U.S.C. 
20 1 19(e) of Provisional Patent Application serial number 60/181,364 filed on 2/8/2000, 
and incorporates all disclosure of the prior applications by reference. 

Background of the Invention 

25 The well-known Internet network is a notoriously well-known publicly- 

accessible communication network at the time of filing the present patent application, 
and arguably the most robust information and communication source ever made 
available. The Internet is used as a prime example in the present application of a data- 
packet-network which will benefit from the apparatus and methods taught in the 

30 present patent application, but is just one such network, following a particular 

standardized protocol As is also very well known, the Internet (and related networks) 
are always a work in progress. That is, many researchers and developers are 



WO 03/005645 



PCT/US02/20316 



competing at all times to provide new and better apparatus and methods, including 
software, for enhancing the operation of such networks. 

In general the most sought-after improvements in data packet networks are 
those that provide higher speed in routing (more packets per unit time) and better 
5 reliability and fidelity in messaging. What is generally needed are router apparatus 
and methods increasing the rates at which packets may be processed in a router. 

As is well-known in the art, packet routers are computerized machines wherein 
data packets are received at any one or more of typically multiple ports, processed in 
some fashion, and sent out at the same or other ports of the router to continue on to 

10 downstream destinations. As an example of such computerized operations, keeping in 
mind that the Internet is a vast interconnected network of individual routers, 
individual routers have to keep track of which external routers to which they are 
connected by communication ports, and of which of alternate routes through the 
network are the best routes for incoming packets. Individual routers must also 

15 accomplish flow accounting, with a flow generally meaning a stream of packets with a 
common source and end destination. A general desire is that individual flows follow 
a common path. The skilled artisan will be aware of many such requirements for 
computerized processing. 

Typically a router in the Internet network will have one or more Central 

20 Processing Units (CPUs) as dedicated microprocessors for accomplishing the many 
computing tasks required. In the current art at the time of the present application, 
these are single-streaming processors; that is, each processor is capable of processing 
a single stream of instructions. In some cases developers are applying multiprocessor 
technology to such routing operations. The present inventors have been involved for 

25 some time in development of dynamic multistreaming (DMS) processors, which 
processors are capable of simultaneously processing multiple instruction streams. 
One preferred application for such processors is in the processing of packets in packet 
networks like the Internet. 

In a data-packet processor, a configurable queuing system for packet accounting 

30 during processing is known to the inventor. The queuing and accounting system has a 
plurality of queues arranged in one or more clusters, an identification mechanism for 
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creating a packet identifier for arriving packets, insertion logic for inserting packet 
identifiers into queues and for determining into which queue to insert a packet 
identifier, and selection logic for selecting packet identifiers from queues to initiate 
processing of identified packets, downloading of completed packets, or for re-queuing 
5 of the selected packet identifiers. 

One aspect of the above-described queuing system involves selecting and 
preloading contexts with packet information for processing and notifying a processing 
component of the activation of the context so that the processor may fetch an 
instruction thread or threads to begin and complete the processing. Such an operation 
10 is typically called an instruction fetch, or simply a FETCH operation in programming 
language. 

In some prior-art processors, there is a pre-fetch operation known wherein the 
processor pre-fetches an instruction thread or threads that will "most likely" be 
required for the processing. Determination for which thread or threads to select is 

15 speculative in this prior-art case, and in some cases, the selected instruction is not the 
correct instruction for the processing of the packet for which it was fetched. The 
desire to enable such pre-fetch operations stems from an overall goal of improving the 
speed of processing for processors in general. If, in the case of a packet processor, 
which is preferred application for the present invention, the instructions can be fetched 

20 while packet preparation operations are simultaneously being performed, then the 
number of cycles required to initiate and complete processing of a packet can be 
reduced. Over multitudes of data packets being processed, this reduction can be 
significant. 

The problem in the prior-art is that the identification and selection of 
25 instructions during a pre-fetch is speculative, meaning that not enough information is 
available at the desired point in time where a pre-fetch operation would be beneficial. 
Therefore, the pre-fetch operation is speculative in nature and not reliable in many 
instances. Logically then, the number of cycles required to process a data packet can 
be increased over what would normally be the case if a speculative pre-fetch returns 
30 incorrect instructions and must then be repeated. 
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What is clearly needed is a method and apparatus that enables a non-speculative 
pre-fetch operation wherein correctness of the fetched instruction or instructions is 
assured. Such a system would further provide reduction of cycles required for packet 
processing and increase processor performance by freeing up other resources for other 
5 operations. 

Summary of the Invention 

In a preferred embodiment of the present invention, in a data-packet processor, 

10 a system for non-speculative pre-fetching is provided, comprising a processing unit 
having a first portion for processing the data packets, using instruction threads 
specific to packet type, and a second portion comprising a pool of context registers 
and functional units for processing, a packet-management unit (PMU) for managing 
data packets of different types received for processing, including selecting and loading 

1 5 the context registers, a memory storing at least an initial instruction of instruction 
threads, and a table equating packet types with pointers to memory locations for the at 
least first instructions of instruction threads specific to the packet types. The system 
is characterized in that the PMU selects a context from the pool of contexts for 
processing of a data packet, the table is consulted for the pointer, and the pointer is 

20 provided to the processing unit first portion, enabling the processing unit first portion 
to prefetch at least an initial instruction for the packet to be processed at least partially 
in parallel with loading of the context. 

In some embodiments the second portion of the processing unit comprises 
separate clusters, each cluster comprising contexts and functional units. Also in some 

25 embodiments the table is in the PMU. The processor may be a dynamic multi- 
streaming processor. Also in preferred embodiments the memory holding at least a 
first instruction of the instruction threads is an on-chip instruction cache memory, 
while in others the memory holding at least a first instruction of the instruction 
threads is an off-chip memory. 
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In some cases data packets to be processed are stored in queues according to 
instruction threads required to process the packets, and the queue from which a packet 
arrives for processing indicates the packet type. 

In another aspect of the invention, in a data-packet processor having a first 
portion for processing data packets, using instruction threads specific to packet type, 
and a second portion comprising a pool of context registers and functional units for 
processing, a method for accomplishing pre-fetch of at least a first instruction for 
processing is provided, comprising steps of (a) selecting, by a packet-management 
unit (PMU), an available context for loading information for processing a packet 
ready for processing; (b) consulting a table relating packet type for the packet ready to 
be processed to a pointer to a memory location for at least a first instruction of an 
instruction thread to process the packet; (c) providing the pointer to the first portion; 
and (d) pre-fetching the at least first instruction of the thread to process the data 
packet, at least partially in parallel with loading the context. 

In some preferred embodiments of the method the second portion of the 
processing unit comprises separate clusters, each cluster comprising contexts and 
functional units. Also in some preferred embodiments the table is in the PMU. The 
processor may be a dynamic multi-streaming processor. Also in preferred 
embodiments the memory holding at least a first instruction of the instruction threads 
is an on-chip instruction cache memory, while in some other the memory holding at 
least a first instruction of the instruction threads is an off-chip memory. In preferred 
embodiments as well, data packets to be processed are stored in queues according to 
instruction threads required to process the packets, and wherein the queue from which 
a packet arrives for processing indicates the packet type. 

In embodiments of the invention described in enabling detail below, for the first 
time a system and method is provided, useful with dynamic multi-streaming 
processors and others, that provides for a non-speculative pre-fetch of instruction 
threads. 
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Brief Description of the Drawings 

Fig. 1 is a simplified block diagram showing relationship of functional areas * 
of a DMS processor in a preferred embodiment of the present invention. 
5 Fig. 2 is a block diagram of the DMS processor of Fig. 1 showing additional 

detail. 

Fig. 3 is a block diagram illustrating uploading of data into the LPM or EPM in 
an embodiment of the invention. 

Fig. 4a is a diagram illustrating determination and allocation for data uploading 
10 in an embodiment of the invention. 

Fig. 4b is a diagram showing the state that needs to be maintained for each of 
the four 64KB blocks. 

Figs. 5a and 5b illustrate an example of how atomic pages are allocated in an 
embodiment of the present invention. 
1 5 Figs. 6a and 6b illustrate how memory space is efficiently utilized in an 

embodiment of the invention. 

Fig. 7 is a top-level schematic of the blocks of the XCaliber PMU unit involved 
in the downloading of a packet. 

Fig. 8 is a diagram illustrating the phenomenon of packet growth and shrink. 
20 Fig. 9 is a block diagram showing high-level communication between the QS 

and other blocks in the PMU and SPU in an embodiment of the present invention. 

Fig. 10 is a table illustrating six different modes in an embodiment of the 
invention into which the QS can be configured. 

Fig. 1 1 is a diagram illustrating generic architecture of the QS of Figs. 2 and 7 
25 in an embodiment of the present invention. 

Fig. 12 is a table indicating coding of the outbound Deviceld field in an 
embodiment of the invention. 

Fig, 13 is a table illustrating priority mapping for RTU transfers in an 
embodiment of the invention. 
30 Fig. 14 is a table showing allowed combinations of Active, Completed, and 

Probed bits for a valid packet in an embodiment of the invention. 
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Fig. 15 is a Pattern Matching Table in an embodiment of the present invention. 
Fig. 16 illustrates the format of a mask in an embodiment of the invention. 
Fig. 17 shows an example of a pre-load operation using the mask in Fig. 16. 
Fig. 18 illustrates shows the PMU Configuration Space in an embodiment of 
5 the present invention. 

Figs. 19a, 19b and 19c are a table of Configuration register Mapping. 
Fig. 20 is an illustration of a PreloadMaskNumber configuration register. 
Fig, 21 illustrates a PatternMatchingTable in a preferred embodiment of the 
present invention. 

10 Fig, 22 illustrates a VirtualPageEnable configuration register in an 

embodiment of the invention. 

Fig. 23 illustrates a ContextSpecificPatternMatchingMask configuration 
register in an embodiment of the invention. 

Fig. 24 illustrates the MaxActivePackets configuration register in an 
1 5 embodiment of the present invention. 

Fig. 25 illustrates the TimeCounter configuration register in an embodiment of 
the present invention. 

Fig. 26 illustrates the StatusRegister configuration register in an embodiment 
of the invention. 

20 Fig. 27 is a schematic of a Command Unit and command queues in an 

embodiment of the present invention. 

Fig. 28 is a table showing the format of command inserted in command queues 
in an embodiment of the present invention. 

Fig. 29 is a table showing the format for responses that different blocks 
25 generate back to the CU in an embodiment of the invention. 

Fig. 30 shows a performance counter interface between the PMU and the SIU 
in an embodiment of the invention. 

Fig. 31 shows a possible implementation of internal interfaces among the 
different units in the PMU in an embodiment of the present invention. 
30 Fig. 32 is a diagram of a BypassHooks configuration register in an 

embodiment of the invention. 
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Fig. 33 is a diagram of an InternalStateWrite configuration register in an 
embodiment of the invention. 

Figs. 34-39 comprise a table listing events related to performance counters in 
an embodiment of the invention. 
5 Fig. 40 is a table illustrating the different bypass hooks implemented in the 

PMU in an embodiment of the invention. 

Fig. 41 is a table relating architecture and hardware blocks in an embodiment of 
the present invention. 

Figs. 42-45 comprise a table showing SPU-PMU Interface in an embodiment of 
10 the invention. 

Figs. 46-49 comprise a table showing SIU-PMU Interface in an embodiment of 
the invention. 

Fig. 50 is a block-diagram logically illustrating components and interaction 
during a pre-fetch operation according to an embodiment of the present invention. 
1 5 Fig. 5 1 is a flow chart illustrating general steps for initiating and completing a 

non-speculative pre-fetch operation according to an embodiment of the present 
invention. 

20 Description of the Preferred Embodiments 

In the provisional patent application S/N 60/1 81,364 referenced above there is 
disclosure as to the architecture of a DMS processor, termed by the inventors the 
XCaliber processor, which is dedicated to packet processing in packet networks. Two 

25 extensive diagrams are provided in the referenced disclosure, one, labeled NIO Block 
Diagram, shows the overall architecture of the XCaliber processor, with input and 
output ports to and from a packet-handling ASIC, and the other illustrates numerous 
aspects of the Generic Queue shown in the NIO diagram. The NIO system in the 
priority document equates to the Packet Management Unit (PMU) in the present 

30 specification. It is to the several aspects of the generic queue that the present 
application is directed. 
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Fig. 1 is a simplified block diagram of an XCaliber DMS processor 101 with a 
higher-level subdivision of functional units than that shown in the NIO diagram of the 
priority document. In Fig. 1 XCaliber DMS processor 101 is shown as organized into 
three functional areas. An outside System Interface Unit (SIU) area 107 provides 
5 communication with outside devices, that is, external to the XCaliber processor, 
typically for receiving and sending packets. Inside, processor 101 is divided into two 
broad functional units, a Packet Management Unit (PMU) 103, equating to the NIO 
system in the priority document mentioned above, and a Stream Processor Unit (SPU) 
107. The functions of the PMU include accounting for and managing all packets 

10 received and processed. The SPU is responsible for all computational tasks. 

The PMU is a part of the XCaliber processor that offloads the SPU from 
performing costly packet header accesses and packet sorting and management tasks, 
which would otherwise seriously degrade performance of the overall processor. 

Packet management is achieved by (a) Managing on-chip memory allocated for 

1 5 packet storage, (b) Uploading, in the background, packet header information from 

incoming packets into different contexts (context registers, described further below) of 
the XCaliber processor, (c) Maintaining, in a flexible queuing system, packet 
identifiers of the packets currently in process in the XCaliber. 

The described packet management and accounting tasks performed by the PMU 

20 are performed in parallel with processing of packets by the SPU core. To implement 
this functionality, the PMU has a set of hardware structures to buffer packets 
incoming from the network, provide them to the SPU core and, if needed, send them 
out to the network when the processing is completed. The PMU features a high 
degree of programmability of several of its functions, such as configuration of its 

25 internal packet memory storage and a queuing system, which is a focus of the present 
patent application. 

Fig. 2 is a block diagram of the XCaliber processor of Fig. 1 showing additional 
detail. SIU 107 and SPU 105 are shown in Fig, 2 as single blocks with the same 
element numbers used in Fig. 1. The PMU is shown in considerably expanded detail, 
30 however, with communication lines shown between elements. 
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In Fig. 2 there is shown a Network/Switching Fabric Interface 203 which is in 
some cases an Application Specific Integrated Circuit (ASIC) dedicated for 
interfacing directly to a network, such as the Internet for example, or to switching 
fabric in a packet router, for example, receiving and transmitting packets, and 
5 transacting the packets with the XCaliber processor. In this particular instance there 
are two in ports and two out ports communicating with processor 201. Network in 
and out interface circuitry 205 and 215 handle packet traffic onto and off the 
processor, and these two interfaces are properly a part of SIU 107, although they are 
shown separately in Fig. 2 for convenience. 
10 Also at the network interface within the PMU there are, in processor 201, input 

and output buffers 207 and 217 which serve to buffer the flow of packets into and out 
of processor 201. 

Referring again to Fig. 1, there is shown a Packet Management Unit (PMU) 
103, which has been described as a unit that offloads the requirement for packet 

15 management and accounting from the Stream Processing Unit. This is in particular 
the unit that has been expanded in Fig. 2, and consists substantially of Input Buffer 
(IB) 207, Output Buffer (OB) 217, Paging Memory Management Unit (PMMU) 209, 
Local Packet Memory (LPM) 219, Command Unit (CU) 213, Queueing System (QS) 
21 1, Configuration Registers 221, and Register Transfer Unit (RTU) 227. The 

20 communication paths between elements of the PMU are indicated by arrows in Fig. 2, 
and further description of the elements of the PMU is provided below, including 
especially QS 21 1, which is a particular focus of the present patent application. 

Overview of PMU 

25 

Again, Fig. 2 shows the elements of the PMU, which are identified briefly 
above. Packets arrive to the PMU in the present example through a 16-byte network 
input interface. In this embodiment packet data arrives to the PMU at a rate of 20 
Gbps (max). At an operating speed of 300MHz XCaliber core frequency, an average 
30 of 8 bytes of packet data are received every XCaliber core cycle. The incoming data 
from the network input interface is buffered in InBuffer (IB) block 207. Network 
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interface 205 within XCaliber has the capability of appending to the packet itself the 
size of the packet being sent, in the event that the external device has not been able to 
append the size to the packet before sending the packet. Up to 2 devices can send 
packet data to XCaliber at (lOGbps per device), and two in ports are shown from an 
5 attached ASIC. It is to be understood that the existence and use of the particular 
ASIC is exemplary, and packets could be received from other devices. Further, there 
may be in some embodiments more or fewer than the two in ports indicated. 

Packet Memory Manager Unit (PMMU) 209 decides whether each incoming 
packet has to be stored into on-chip Local Packet Memory (LPM) 219, or, in the case 
10 that, for example, no space exists in the LPM to store it, may decide to either send the 
packet out to an External Packet Memory (EPM) not shown through the SIU block, or 
may decide to drop the packet In case the packet is to be stored in the LPM, the 
PMMU decides where to store the packet and generates all the addresses needed to do 
so. The addresses generated correspond in a preferred embodiment to 16-byte lines in 
1 5 the LPM, and the packet is consecutively stored in this memory. 

In the (most likely) case that the PMMU does not drop the incoming packet, a 

packet identifier is created, which includes a pointer (named packetPage) to a fixed- 
size page in packet memory where the packet has started to be stored. The identifier 
is created and enqueued into Queuing System (QS) block 211. The QS assigns a 
20 number from 0 to 255 (named packetNumber) to each new packet The QS sorts the 
identifiers of the packets alive in XCaliber based on the priority of the packets, and it 
updates the sorting when the SPU core notifies any change on the status of a packet. 
The QS selects which packet identifiers will be provided next to the SPU. Again, the 
QS is a particular focus of the present application. 
25 Register Transfer Unit (RTU) block 227, upon receiving a packet identifier 

(packetPage and packetNumber) from the QS, searches for an available context (229, 
Fig. 2) out of 8 contexts that XCaliber features in a preferred embodiment. For 
architectural and description purposes the contexts are considered a part of a broader 
Stream Processing Unit, although the contexts are shown in Fig. 2 as a separate unit 
30 229. 
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In the case that no context is available, the RTU has the ability to notify the 
SPU about this event through a set of interrupts. In the case that a context is 
available, the RTU loads the packet identifier information and some selected fields of 
the header of the packet into the context, and afterwards it releases the context (which 
5 will at that time come under control of the SPU. The RTU accesses the header 

information of the packet through the SIU, since the packet could have been stored in 
the off-chip EPM. 

Eventually a stream in the SPU core processes the context and notifies the QS 
of this fact There are, in a preferred embodiment, eight streams in the DMS core. 

10 The QS then updates the status of the packet (to completed), and eventually this 

packet is selected for downloading (i.e. the packet data of the corresponding packet is 
sent out of the XCaliber processor to one of the two external devices). 

When a packet is selected for downloading, the QS sends the packetPage 
(among other information) to the PMMU block, which generates the corresponding 

1 5 line addresses to read the packet data from the LPM (in case the packet was stored in 
the on-chip local memory) or it will instruct the SIU to bring the packet from the 
external packet memory to the PMU. In any case, the lines of packet data read are 
buffered into the OutBuffer (OB) block, and from there sent out to the device through 
the 16-byte network output interface. This interface is independent of its input 

20 counterpart. The maximum aggregated bandwidth of this interface in a preferred 
embodiment is also 20 Gbps, lOGbps per output device. 

CommandUnit (CU) 213 receives commands sent by SPU 105. A command 
corresponds to a packet instruction, which are in many cases newly defined 
instructions, dispatched by the SPU core. These commands are divided into three 

25 independent types, and the PMU can execute one command per type per cycle (for a 
total of up to 3 commands per cycle). Commands can be load-like or store-like 
(depending on whether the PMU provides a response back to the SPU or not, 
respectively). 

A large number of features of the PMU are configured by the SPU through 
30 memory-mapped configuration registers 221 . Some such features have to be 

programmed at boot time, and the rest can be dynamically changed. For some of the 
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latter, the SPU has to be running in a single-thread mode to properly program the 
functionality of the feature. The CU block manages the update of these configuration 
registers. 

The PMU provides a mechanism to aid in flow control between ASIC 203 and 
5 XCaliber DMS processor 201. Two different interrupts are generated by the PMU to 
SPU 105 when LPM 219 or QS 21 1 are becoming full. Software controls how much 
in advance the interrupt is generated before the corresponding structure becomes 
completely full. Software can also disable the generation of these interrupts. 

10 LPM 219 is also memory mapped, and SPU 105 can access it through the 

conventional load/store mechanism. Both configuration registers 221 and LPM 219 
have a starting address (base address) kept by SIU 107. Requests from SPU 105 to 
LPM 219 and the configuration space arrive to the PMU through SIU block 107. The 
SIU is also aware of the base address of the external packet memory. 

15 

In Buffer (IB) 

Packet data sent by an external device arrives to the PMU through the network 
20 input interface 205 at an average rate of 8 bytes every XCaliber core cycle in a 
preferred embodiment. IB block 207 of the PMU receives this data, buffers it, and 
provides it, in a FIFO-like fashion, to LPM 219 and in some cases also to the SIU (in 
case of a packet overflow, as explained elsewhere in this specification. 

XCaliber DMS processor 201 can potentially send/receive packet data to/from 
25 up to 2 independent devices. Each device is tagged in SIU 107 with a device 
identifier, which is provided along with the packet data. When one device starts 
sending data from a packet, it will continue to send data from that very same packet 
until the end of the packet is reached or a bus error is detected by the SIU. 

In a preferred embodiment the first byte of a packet always starts at byte 0 of the 
30 first 1 6 bytes sent of that packet. The first two bytes of the packet specify the size in 
bytes of the packet (including these first two bytes). These two bytes are always 



WO 03/005645 



PCT/US02/20316 



-14- 

appended by the SIU if the external device has not appended them. If byte A: in the 16- 
byte chunk is a valid byte, bytes 0..fc-l are also valid bytes. This can be guaranteed 
since the first byte of a packet always starts at byte 0. Note that no valid bits are 
needed to validate each byte since a packet always starts at byte 0 of the 16-byte 
5 chunk, and the size of the packet is known up front (in the first two bytes). The 
network interface provides, at every core clock, a control bit specifying whether the 
16-byte chunk contains, at least, one valid byte. 

The valid data received from the network input interface is organized in buffer 
207. This is an 8-entry buffer, each entry holding the 16-bytes of data plus the control 

10 bits associated to each chunk. PMMU 209 looks at the control bits in each entry and 
determines whether a new packet starts or to which of the (up to) two active packets 
the data belongs to, and it acts accordingly. 

The 16-byte chunks in each of the entries in IB 207 are stored in LPM 219 or in 
the EPM (not shown). 1 1 is guaranteed by either the LPM controller or the SIU that 

15 the bandwidth to write into the packet memory will at least match the bandwidth of 
the incoming packet data, and that the writing of the incoming packet data into the 
packet memory will have higher priority over other accesses to the packet memory. 

In some cases IB 207 may get full because PMMU 209 may be stalled, and 
therefore the LPM will not consume any more data of the IB until the stall is resolved. 

20 Whenever the IB gets full, a signal is sent to network input interface 205, which will 
retransmit the next 16-byte chunk as many times as needed until the IB accepts it 
Thus, no packet data is lost due to the IB getting full. 

Out Buffer (OB) 

25 

Network output interface 215 also supports a total aggregated bandwith of 20 
Gbps (lOGbps per output device), as does the Input Interface. At 300 MHz XCaliber 
clock frequency, the network output interface accepts in average 8 bytes of data every 
XCaliber cycle from the OB block, and sends it to one of the two output devices. The 
30 network input and output interfaces are completely independent of each other. 



WO 03/005645 



PCTYUS02/20316 



-15- 

Up to 2 packets (one per output device) can be simultaneously sent. The device 
to which the packet is sent does not need to correspond to the device that sent the 
packet in. The packet data to be sent out will come from either LPM 21 9 or the EPM 
(not shown). 

5 For each of the two output devices connected at Network Out interface 2 1 5, 

PMMU 209 can have a packet ready to start being downloaded, a packet being 
downloaded, or no packet to download. Every cycle PMMU 209 selects the highest 
packet across both output devices and initiates the download of 16 bytes of data for 
that packet. Whenever the PMMU is downloading packet data from a packet to an 

10 output device, no data from a different packet will be downloaded to the same device 
until the current packet is completely downloaded. 

The 16-byte chunks of packet data read from LPM 219 (along with some 
associated control information) are fed into one of the two 8-entry buffers (one per 
device identifier). The contents of the head of one of these buffers is provided to the 

15 network output interface whenever this interface requests it When the head of both 
buffers is valid, the OB provides the data in a round robin fashion. 

Differently than the network input interface, in the 16-byte chunk sent to the 
network output interface it can not be guaranteed that if a byte k is valid, then bytes 
0..A:-1 are valid as well. The reason for this is that when the packet is being sent out, it 

20 does not need to start at byte 0 of the 16-byte chunk in memory. Thus, for each 16- 
byte chunk of data that contains the start of the packet to be sent out, OB 217 needs to 
notify the network interface where the first valid byte of the chunk resides. Moreover, 
since the first two bytes of the packet contain the size of the packet in bytes, the 
network output interface has the information to figure out where the last valid byte of 

25 the packet resides within the last 1 6-byte chunk of data for that packet. Moreover, OB 
217 also provides a control bit that informs SIU 107 whether it needs to compute CRC 
for the packet, and if so, which type of CRC. This control bit is provided by PMMU 
209 to OB 217. 



30 
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Pa ging Memory Management Unit (PMMU) 

The packet memory address space is 16MB. Out of the 16MB, the XCaliber 
processor features 256KB on-chip. The rest (or a fraction) is implemented using 
5 external storage. 

The packet memory address space can be mapped in the TLB of SPU 105 as 
user or kernel space, and as cachable or uncachable. In case it is mapped cachable, 
the packet memory space is cached (write-through) into an LI data cache of SPU 105, 
but not into an L2 cache. 

10 A goal of PMMU 209 is to store incoming packets (and SPU-generated packets 

as well) into the packet memory. In case a packet from the network input interface 
fits into LPM 219, PMMU 209 decides where to store it and generates the necessary 
write accesses to LPM 219; in case the packet from the network input interface is 
going to be stored in the EPM, SPU 105 decides where in the EPM the packet needs 

15 to be stored and SIU 107 is in charge of storing the packet In either case, the packet is 
consecutively stored and a packet identifier is created by PMMU 209 and sent to QS 
211. 

- SPU 105 can configure LPM 219 so packets larger than a given size will never 
be stored in the LPM. Such packets, as well as packets that do not fit into the LPM 
20 because lack of space, are sent by PMMU 209 to the EPM through SIU 107. This is a 
mechanism called overflow and is configured by the SPU for the PMU to do so. If no 
overflow of packets is allowed, then the packet is dropped. In this case, PMMU 209 
interrupts the SPU (again, if configured to do so). 

25 Uploading a packet into packet memory 

Whenever there is valid data at the head of IB 205, the corresponding device 
identifier bit is used to determine to which packet (out of the two possible packets 
being received) the data belongs. When the network input interface starts sending 
30 data of a new packet with device identifier d $ all the rest of the data will eventually 
arrive with that same device identifier d unless an error is notified by the network 
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interface block. The network input interface can interleave data from two different 
device identifier but in a given cycle only data from one device is received by IB 
207. 

When a packet needs to be stored into LPM 219, PMMU block 209 generates 
5 all the write addresses and write strobes to LPM 219. If the packet needs to be stored 
into the EPM, SIU 107 generates them. 

Fig. 3 is a diagram illustrating uploading of data into either LPM 219 or the 
EPM, which is shown in Fig. 3 as element 305, but not shown in Fig. 2. The write 
strobe to the LPM or EPM will not be generated unless the header of the IB has valid 
10 data. Whenever the write strobe is generated, the 16-byte chunk of data at the head of 
the IB (which corresponds to a LPM line) is deleted from the IB and stored in the 
LPM or EPM. The device identifier bit of the head of the IB is used to select the 
correct write address out of the 2 address generators (one per input device). 

In the current embodiment only one incoming packet can be simultaneously 
1 5 stored in the EPM by the SIU (i.e. only one overflow packet can be handled by the 
SIU at a time). Therefore, if a second packet that needs to be overflowed is sent by 
the network input interface, the data of this packet will be thrown away (i.e. the packet 
will be dropped). 

20 A Two Byte Packet-Size Header 

The network input interface always appends two bytes to a packet received from 
the external device (unless this external device already does so, in which case the SIU 
will be programmed not to append them). This appended data indicates the size in 
25 bytes of the total packet, including the two appended bytes. Thus, the maximum size 
of a packet that is processed by the XCaliber DMS processor is 65535 bytes including 
the first two bytes. 

The network output interface expects that, when the packet is returned by the 
PMU (if not dropped during its processing), the first two bytes also indicate the size 
30 of the processed packet. The size of the original packet can change (the packet can 
increase or shrink) as a result of processing performed by the XCaliber processor. 
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Thus, if the processing results in increasing the size beyond 64K-1 bytes, it is the 
responsibility of software to chop the packet into two different smaller packets. 

The PMU is more efficient when the priority of the packet being received is 
known up front. The third byte of the packet will be used for priority purpose if the 
5 external device is capable of providing this information to the PMU. The software 
programs the PMU to either use the information in this byte or not, which is does 
through a boot-time configuration register named Log2InQueues. 

Dropping a packet 

10 

A packet completely stored in either LPM 219 or EPM 305 will be dropped 
only if SPU 105 sends an explicit command to the PMU to do so. No automatic 
dropping of packets already stored in the packet memory can occur. In other words, 
any dropping algorithm of packets received by the XCaliber DMS processor is 

15 implemented in software. 

There are, however, Several situations wherein the PMU may drop an incoming 
packet. These are (a) The packet does not fit in the LPM and the overflow of packets 
is disabled, (b) The total amount of bytes received for the packet is not the same as the 
number of bytes specified by the ASIC in the first two bytes of the ASIC-specific 

20 header, or (c) A transmission error has occurred between the external device and the 
network input interface block of the SIU. The PMMU block is notified about such an 
error. 

For each of the cases (a), (b) and (c) above, an interrupt is generated to the SPU. 
The software can disable the generation of these interrupts using 
25 AutomaticPacketDropIntEnable, PacketErrorlntEnable on-the-fly configuration flags. 

Virtual Pages 

An important process of PMMU 209 is to provide an efficient way to 
30 consecutively store packets into LPM 219 with as little memory fragmentation as 
possible. The architecture in the preferred embodiment provides SPU 105 with a 
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capability of grouping, as much as possible, packets of similar size in the same region 
of LPM 219. This reduces overall memory fragmentation. 

To implement the low-fragmentation feature, LPM 219 is logically divided into 
4 blocks of 64KB bytes each. Each block is divided into fixed atomic pages of 256 
5 bytes. However, every block has virtual pages that range from 256 bytes up to 64KB, 
in power-of-2 increments. Software can enable/disable the different sizes of the 
virtual pages for each of the 4 blocks using an on-the-fly configuration register named 
VirtualPageEnable. This allows configuring some blocks to store packets of up to a 
certain size. 

10 The organization and features of the PMU assure that a packet of size s will 

never be stored in a block with a maximum virtual page size less than s. However, a 
block with a minimum virtual page size of r will accept packets of size smaller than r. 
This will usually be the case, for example, in which another block or blocks are 
configured to store these smaller packets, but is full. 

15 Software can get ownership of any of the four blocks of the LPM, which implies 

that the corresponding 64KB of memory will become software managed. A 
configuration flag exists per block (SoftwareOwned) for this purpose. The PMMU 
block will not store any incoming packet from the network input interface into a block 
in the LPM with the associated SoftwareOwned flag asserted. Similarly, the PMMU 

20 will not satisfy a GetSpace operation (described elsewhere) with memory of a block 
with its SoftwareOwned flag asserted. The PMMU, however, is able to download any 
packet stored by software in a software-owned block. 

The PMMU logic determines whether an incoming packet fits in any of the 
blocks of the LPM. If a packet fits, the PMMU decides in which of the four blocks 

25 (since the packet may fit in more than one block), and the first and last atomic page 
that the packet will use in the selected block. The atomic pages are allocated for the 
incoming packet. When packet data stored in an atomic page has been safely sent out 
of the XCaliber processor through the network output interface, the corresponding 
space in the LPM can be de-allocated (i.e. made available for other incoming packets), 

30 The EPM, like the LPM is also logically divided into atomic pages of 256 bytes. 

However, the PMMU does not maintain the allocation status of these pages. The 
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allocation status of these pages is managed by software. Regardless of where the 
packet is stored, the PMMU generates an offset (in atomic pages) within the packet 
memory to where the first data of the packet is stored. This offset is named 
henceforth packetPage. Since the maximum size of the packet memory is 16MB, the 
5 packetPage is a 16-bit value. 

As soon as the PMMU safely stores the packet in the LPM, or receives 
acknowledgement from SIU 107 that the last byte of the packet has been safely stored 
in the EPM, the packetPage created for that packet is sent to the QS. Operations of 
the QS are described in enabling detail below. 

10 

Generating the packetPage offset 

The PMMU always monitors the device identifier (deviceld) associated to the 
packet data at the head of the IB. If the deviceld is not currently active (i.e. the 

15 previous packet sent by that deviceld has been completely received), that indicates 
that the head of the IB contains the first data of a new packet. In this case, the first 
two bytes (byteO and bytel in the 16-byte chunk) specify the size of the packet in 
bytes. With the information of the size of the new incoming packet, the PMMU 
determines whether the packet fits into LPM 219 and, if it does, in which of the four 

20 blocks it will be stored, plus the starting and ending atomic pages within that block. 

The required throughput in the current embodiment of the PMMU to determine 
whether a packet fits in LPM 219 and, if so, which atomic pages are needed, is one 
packet every two cycles. One possible two-cycle implementation is as follows: (a) 
The determination happens in one cycle, and only one determination happens at a time 

25 (b) In the cycle following the determination, the atomic pages needed to store the 
packet are allocated and the new state (allocated/de-allocated) of the virtual pages are 
computed. In this cycle, no determination is allowed. 

Fig. 4a is a diagram illustrating determination and allocation in parallel for local 
packet memory. The determination logic is performed in parallel for all of the four 64 

30 KB blocks as shown. 
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Fig. 4b shows the state that needs to be maintained for each of the four 64KB 
blocks. This state, named AllocationMatrix, is recomputed every time one or more 
atomic pages are allocated or de-allocated, and it is an input for the determination 
logic. The Fits Vector and IndexVector contain information computed from the 
5 AllocationMatrix. 

AllocationMatrixtFPiS^tKP/nrfex] indicates whether virtual page number 
VPIndex of size VPSize in bytes is already allocated or not. FitsVector[FPiSzze] ^ 
indicates whether the block has at least one non-allocated virtual page of size VPSize. 
If FitsVectortPPStze] is asserted, Index Vectox[VPSize] vector contains the index of a 
1 0 non-allocated virtual page of size VPSize. 

The SPU programs which virtual page sizes are enabled for each of the blocks. 
The EnableVectorff'PiSfee] contains this information. This configuration is performed 
using the VirtualPageEnable on-the-fly configuration register. Note that the 
AllocationMatrix[][], FitsVector[], IndexVectorQ and EnableVector[] are don't cares 
1 5 if the corresponding SoftwareOwned flag is asserted. 

In this example the algorithm for the determination logic (for a packet of size s 
bytes) is as follows: 

1) Fits logic : check, for each of (he blocks, whether the packet fits in or not. If it 
20 fits, remember the virtual page size and the number of the first virtual page of 



that size. 



For All Block j Do (can be done in parallel): 

Fits[/] = (s <= VPSize) AND FitsVector[ VPSize] AND 
Not SoftwareOwned 



25 



where VPSize is the smallest possible page size. 



If(Fits[/]) 



VPIndexQ] 
MinVPS[/] 



Index Vectot[VPSize] 



VPSize 



Else 



30 



MinVPS[/] 



<Infinity> 
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2) Block selection : the blocks with the smallest virtual page (enabled or not) that 
is able to fit the packet in are candidates. The block with the smallest enabled 
virtual page is selected. 

If FitsD] = FALSE for all j Then 
5 <Packet does not fit in LPM> 

packetPage = Overflow Address » 8 

Else 

C= set of blocks with smallest MinVPS AND 
Fits[MinVPS] 

10 B = block# in C with the smallest enabled virtual 

page 

(if more than one exists, pick die smallest block number) 
If one or more blocks in C have virtual pages enabled 
Then 

15 Index = VPIndex[5] 

VPSize = MinVPS[B] 
NumAPs = cdl(S/256) 

packetPage = (5*64KB + Index*VPSize) » 8 

Else 

20 <Packet does not fit in LPM> 

packetPage = OverflowAddress » 8 

i 

If the packet fits in the LPM, the packetPage created is then the atomic page 
number within the LPM (there are up to IK different atomic pages in the LPM) into 
25 which the first data of the packet is stored. If the packet does not fit, then the 

packetPage is the contents of the configuration register OverflowAddress right-shifted 
8 bits. The packet overflow mechanism is described elsewhere in this specification, 
with a subheader "Packet overflow". 

In the cycle following the determination of where the packet will be stored, the 
30 new values of the AllocationMatrix, Fits Vector and IndexVector must be recomputed 
for the selected block. If FitsVector[FTS/ze] is asserted, then lndzxYector[VPSize] is 
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the index of the largest non-allocated virtual page possible for the corresponding 
virtual page size. If FitsVector[KP&ze] is de-asserted, then IndexVector[FPiSfee] is 
undefined. 

The number of atomic pages needed to store the packet is calculated (NumAPs) 
S and the corresponding atomic pages are allocated. The allocation of the atomic pages 
for the selected block (B) is done as follows: 

1 . The allocation status of the atomic pages in AllocationMatrix[APsize](y..A], t / 
being the first atomic page and k the last one (k-j+l - NumAPs), are set to 
allocated. 

1 0 2. The allocation status of the virtual pages in AllocationMatrix[r]|yj are updated 
following the mesh structure in Fig. 4b. (a 2 k+l -byte virtual page will be 
allocated if any of the two 2 k -byte virtual pages that it is composed of is 
allocated). 

When the packetPage has been generated, it is sent to the QS for enqueueing. If 
15 the QS is fall (very rare), it will not be able to accept the packetPage being provided 
by the PMMU. In this case, the PMMU will not be able to generate a new packetPage 
for the next new packet. This puts pressure on the IB, which might get full if the QS 
remains fall for several cycles. 

The PMMU block also sends the queue number into which the QS has to store 
20 the packetPage. How the PMMU generates this queue number is described below in 
sections specifically allocated to the QS. 

Page Allocation example 

25 Figs. 5a and 5b illustrate an example of how atomic pages are allocated. For 

simplicity, the example assumes 2 blocks (0 and 1) of 2KB each, with an Atomic page 
size of 256 bytes, and both blocks have their SoftwareOwned flag de-asserted. Single 
and double cross-hatched areas represent allocated virtual pages (single cross-hatched 
pages correspond to the pages being allocated in the current cycle). The example 

30 shows how the pages get allocated for a sequence of packet sizes of 256, 5 1 2, 1 K and 
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5 12 bytes. Note that, after this sequence, a 2K-byte packet, for example, will not fit in 
the example LPM. 

Whenever the FitsVectorfFPSize] is asserted, the Index Vectox[VPSize] contains 
the largest non-allocated virtual page index for virtual page size VPSize. The reason 

5 for choosing the largest index is that the memory space is better utilized* This is 
shown in Figs. 6a and 6b, where two 256-byte packets are stored in a block. In 
scenario A, the 256-byte virtual page is randomly chosen, whereas in scenario B, the 
largest index is always chosen. As can be seen, the block in scenario A only allows 
two 5 12-byte virtual pages, whereas the block in scenario B allows three. Both, 

1 0 however, allow the same number of 256-byte packets since this is the smallest 

allocation unit. Note that the same effect is obtained by choosing the smallest virtual 
page index number all the time. 
Packet overflow 

15 The only two reasons why a packet cannot be stored in the LPM are (a) that 

the size of the packet is larger than die maximum virtual page enabled across all 4 
blocks; or (b) that the size of the packet is smaller than or equal to the maximum 
virtual page enabled but no space could be found in the LPM. 

When a packet does not fit into the LPM, the PMMU will overflow the packet 

20 through the SIU into the EPM. To do so, the PMMU provides the initial address to 
the SIU (16-byte offset within the packet memory) to where the packet will be stored. 
This 20-bit address is obtained as follows: (a) The 16 MSB bits correspond to the 16 
MSB bits of the Overflow Address configuration register (i.e. the atomic page number 
within the packet memory), (b) The 4 LSB bits correspond to the 

25 HeaderGrowthOffset configuration register. The packetPage value (which will be 
sent to the QS) for this overflowed packet is then the 16 MSB bits of the 
OverflowAddress configuration register. 

If the on-the-fly configuration flag OverflowEnable is asserted, the PMMU will 
generate an OverflowStartedlnt interrupt. When the OverflowStartedlnt interrupt is 

30 generated, the size in bytes of the packet to overflow is written by the PMMU into the 
SPU-read-only configuration register SizeOfOverflowedPacket. At this point, the 
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PMMU sets an internal lock flag that will prevent a new packet from overflowing. 
This lock flag is reset when the software writes into the on-the-fly configuration 
register Overflow Address. If a packet needs to be overflowed but the lock flag is set, 
the packet will be dropped. 

With this mechanism, it is guaranteed that only one interrupt will be generated 
and serviced per packet that is overflowed. This also creates a platform for software 
to decide where the starting address into which the next packet that will be overflowed 
will be stored is visible to the interrupt service routine through the 
SizeOfOverflowedPacket register. In other words, software manages the EPM. 

If software writes the OverflowAddress multiple times in between two 
OverflowStartedlnt interrupts, the results are undefined. Moreover, if software sets 
the 16 MSB bits of OverflowAddress to 0..1023, results are also undefined since the 
first IK atomic pages in the packet memory correspond to the LPM. 

Downloading a packet from packet memory 

Eventually the SPU will complete the processing of a packet and will inform the 
QS of the fact At this point the packet may be downloaded from memory, either 
LPM or EPM, and sent, via the OB to one of the connected devices. Fig. 7 is a top- 
level schematic of the blocks of the XCaliber DMS processor involved in the 
downloading of a packet, and the elements in Fig. 7 are numbered the same as in Fig. 
2. The downloading process may be followed in Fig. 7 with the aid of the following 
descriptions. 

When QS 21 1 is informed that processing of a packet is complete, the QS marks 
this packet as completed and, a few cycles later (depending on the priority of the 
packet), the QS provides to PMMU 209 (as long as the PMMU has requested it) the 
following information regarding the packet: 

(a) the packetPage 

(b) the priority (cluster number from which it was extracted) 

(c) the tail growth/shrink information (described later in spec) 

(d) the outbound device identifier bit 
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(e) the CRC type field (described later in spec) 

(f) the KeepSpace bit 

The device identifier sent to PMMU block 209 is a 1-bit value that specifies 

5 the external device to which the packet will be sent. This outbound device identifier 
is provided by software to QS 21 1 as a 2-bit value. 

If the packet was stored in LPM 219, PMMU 209 generates all of the (16-byte 
line) read addresses and read strobes to LPM 219. The read strobes are generated as 
soon as the read address is computed and there is enough space in OB 217 to buffer 

10 the line read from LPM 219. Buffer d in the OB is associated to device identifier d. 
This buffer may become full for either two reasons: (a) The external device d 
temporarily does not accept data from XCaliber; or (b) The rate of reading data from 
the OB is lower than the rate of writing data into it 

As soon as the packet data within an atomic page has all been downloaded and 

1 5 sent to the OB, that atomic page can be de-allocated. The de-allocation of one or 
more atomic pages follows the same procedure as described above. However, no de- 
allocation of atomic pages occurs if the LPM bit is de-asserted. The KeepSpace bit is 
a don't care if the packet resides in EPM 701. 

If the packet was stored in EPM 701, PMMU 209 provides to SIU 107 the 

20 address within the EPM where the first byte of the packet resides. The SIU performs 
the downloading of the packet from the EPM. The SIU also monitors the buffer space 
in the corresponding buffer in OB 217 to determine whether it has space to write the 
16-byte chunk read from EPM 701. When the packet is fully downloaded, the SIU 
informs the PMMU of the fact so that the PMMU can download the next packet with 

25 the same device identifier. 

When two packets (one per device) are being simultaneously sent, data from the 
packet with highest priority is read out of the memory first. This preemption can 
happen at a 16-byte boundary or when the packet finishes its transmission. If both 
packets have the same priority (provided by the QS), a round-robin method is used to 

30 select the packet from which data will be downloaded next. This selection logic also 
takes into account how full the two buffers in the OB are. If buffer d is full, for 
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example, no packet with a device identifier d will be selected in the PMMU for 
downloading the next 16-byte chunk of data. 

When a packet starts to be downloaded from the packet memory (local or 
external), the PMMU knows where the first valid byte of the packet resides. 

5 However, the packet's size is not known until the first line (or the first two lines in 
some cases) of packet data is read from the packet memory, since the size of the 
packet resides in the first two bytes of the packet data. Therefore, the processing of 
downloading a packet first generates the necessary line addresses to determine the size 
of the packet, and then, if needed, generates the rest of the accesses. 

10 This logic takes into account that the first two bytes that specify the size of the 

packet can reside in any position in the 16-byte line of data. A particular case is when 
the first two bytes span two consecutive lines (which will occur when the first byte is 
the 16th byte of a line, and second byte is the I s1 byte of next line. 

As soon as the PMMU finishes downloading a packet (all the data of that packet 

15 has been read from packet memory and sent to OB), the PMMU notifies the QS of 
this event. The QS then invalidates the corresponding packet from its queuing 
system. 

When a packet starts to be downloaded, it cannot be preempted, i.e. the packet 
will finish its transmission. Other packets that become ready to be downloaded with 
20 the same outbound device identifier while the previous packet is being transmitted 
cannot be transmitted until the previous packet is fully transmitted. 
Packet growth/shrink 

As a result of processing a packet, the size of a network packet can grow, shrink 
25 or remain the same size. If the size varies, the SPU has to write the new size of the 
packet in the same first two bytes of the packet. The phenomenon of packet growth 
and shrink is illustrated in Fig. 8. 

Both the header and the tail of the packet can grow or shrink. When a packet 
grows, the added data can overwrite the data of another packet that may have been 
30 stored right above the packet experiencing header growth, or that was stored right 
below in the case of tail growth. To avoid this problem the PMU can be configured so 
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that an empty space is allocated at the front and at the end of every packet when it is 
stored in the packet memory. These empty spaces are specified with 
HeaderGrowthOffset and TailGrowthOffset boot-time configuration registers, 
respectively, and their granularity is 16 bytes. The maximum HeaderGrowthOffset is 
5 240 bytes (15 16-byte chunks), and the maximum TailGrowthOffset is 1008 bytes (63 
16-byte chunks). The minimum in both cases is 0 bytes. Note that these growth offsets 
apply to all incoming packets, that is, there is no mechanism to apply different growth 
offsets to different packets. 

When the PMMU searches for space in the LPM, it will look for contiguous 

10 space of Size(packet) + ((HeaderGrowthOffset + TailGrowthOffset) « 4). Thus, the 
first byte of the packet (first byte of the ASIC-specific header) will really start at 
offset ((packetPage « 8)+ (HeaderGrowthOffset « 4)) within the packet memory. 

The software knows what the default offsets are, and, therefore, knows how 
much the packet can safely grow at both the head and the tail. In case the packet 

15 needs to grow more than the maximum offsets, the software has to explicitly move the 
packet to a new location in the packet memory. The steps to do this are as follows: 

1) The software requests the PMU for a chunk of contiguous space of the new 
size. The PMU will return a new packetPage that identifies (points to) this new 

20 space. 

2) The software writes the data into the new memory space. 

3) The software renames the old packetPage with the new packetPage. 

4) The software requests the PMU to de-allocate the space associated to the old 
packetPage. 

25 

In the case of header growth or shrinkage, the packet data will no longer start at 
((packetPage « 8) + (HeaderGrowthOffset « 4)). The new starting location is 
provided to the PMU with a special instruction executed by the SPU when the 
processing of the packet is completed. This information is provided to the PMMU by 
30 the QS block. 
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Time stamp 

The QS block of the PMU (described in detail in a following section) guarantees 

5 the order of the incoming packets by keeping the packetPage identifiers of the packets 
in process in the XCaliber processor in FIFO-like queues. However, software may 
break this ordering by explicitly extracting identifiers from the QS, and inserting them 
at the tail of any of the queues. 

To help software in guaranteeing the relative order of packets, the PMU can be 

10 configured to time stamp every packet that arrives to the PMMU block using an on- 
the-fly configuration flag TimeStampEnabled. The time stamp is an 8-byte value, 
obtained from a 64-bit counter that is incremented every core clock cycle. 

When the time stamp feature is on, the PMMU appends the 8-byte time stamp 
value in front of each packet, and the time stamp is stripped off when the packet is 

15 sent to the network output interface. The time stamp value always occupies the 8 
MSB bytes of the (A;-l)th 16-byte chunk of the packet memory, where k is the 16-byte 
line offset where the data of the packet starts (k >0). In the case that 
HeaderGrowthOffset is 0, the time stamp value will not be appended, even if 
TimeStampEnabled is asserted. 

20 The full 64-bit time counter value is provided to software through a read-only 

configuration register (TimeCounter); 

Software operations on the PMMU 

25 Software has access to the PMMU to request or free a chunk of contiguous 

space. In particular, there are two operations that software can perform on the 
PMMU. Firstly the software, through an operation GetSpace(s/ze), may try to find a 
contiguous space in the LPM for size bytes. The PMU replies with the atomic page 
number where the contiguous space that has been found starts (i.e. the packetPage), 

30 and a success bit. If the PMU was able to find space, the success bit is set to * 1\ 
otherwise it is set to *0\ GetSpace will not be satisfied with memory of a block that 
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has its SoftwareOwned configuration bit asserted. Thus, software explicitly manages 
the memory space of software-owned LPM blocks. 

The PMMU allocates the atomic pages needed for the requested space. The 
EnableVector set of bits used in the allocation of atomic pages for incoming packets is 
5 a don't care for the GetSpace operation. In other words, as long as sufficient 

consecutive non-allocated atomic pages exist in a particular block to cover size bytes, 
the GetSpace(size) operation will succeed even if all the virtual pages in that block are 
disabled. 

Moreover, among non-software-owned blocks, a GetSpace operation will be served 
10 first using a block that has all its virtual pages disabled. If more than such a block 

exists, the smallest block number is chosen. If size is 0, GetSpacefc/re) returns '0\ 
The second operation software can perform on the PMMU is 

YreeSp2ice(packetPage). In this operation the PMU de-allocates atomic pages that 

were previously allocated (starting at packetPage). This space might have been either 
1 5 automatically allocated by the PMMU as a result of an incoming packet, or as a result 

of a GetSpace command. FreeSpace does not return any result to the software. A 

FreeSpace operation on a block with its SoftwareOwned bit asserted is disregarded 

(nothing is done and no result will be provided to the SPU). 

20 Local Packet Memory 

Local Packet Memory (LPM), illustrated as element 219 in FIGS. 2 and 7, has 
in the instant embodiment a size of 256KB, 16-byte line width with byte enables, 2 
banks (even/odd), one Read and one Write port per bank, is fully pipelined, and has 
25 one cycle latency 

The LPM in packet processing receives read and write requests from both the 
PMMU and the SIU. An LPM controller guarantees that requests from the PMMU 
have the highest priority. The PMMU reads at most one packet while writing another 
one. The LPM controller guarantees that the PMMU will always have dedicated ports 
30 to the LPM. 
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Malicious software could read/write the same data that is being written/read by 
the PMMU. Thus, there is no guarantee that the read and write accesses in the same 
cycle are performed to different 16-byte line addresses. 

A request to the LPM is defined in this example as a single access (either read 
5 or write) of 16-bytes. The SIU generates several requests for a masked load or store, 
which are new instructions known to the inventors and the subject of at least one 
separate patent application. Therefore, a masked load/store operation can be stalled in 
the middle of these multiple requests if the highest priority PMMU access needs the 
same port 

10 When the PMMU reads or writes, the byte enable signals are assumed to be set 

(i.e. all 16 bytes in the line are either read or written). When the SIU drives the reads 
or writes, the byte enable signals are meaningful and are provided by the SIU. 

When the SPU reads a single byte/word in the LPM, the SIU reads the 
corresponding 16-byte line and performs the extraction and right alignment of the 

15 desired byte/word. When the SPU writes a single byte/word, the SIU generates a 16- 
byte line with the byte/word in the correct location, plus the valid bytes signals. 

Prioritization among operations 

20 The PMMU may receive up to three requests from three different sources (IB, 

QS and software) to perform operations. For example, requests may come from the 
IB and/or Software: to perform a search for a contiguous chunk of space, to allocate 
the corresponding atomic page sizes and to provide the generated packetPage. 
Requests may also come from the QS and/or Software to perform the de-allocation of 

25 the atomic pages associated to a given packetPage. 

It is required that the first of these operations takes no more than 2 cycles, and 
the second no more than one. The PMMU executes only one operation at a time. 
From highest to lowest, the PMMU block will give priority to requests from: IB, QS 
and Software. 



\ 
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Early full-PMMU detection 

The PMU implements a mechanism to aid in flow control between any external 
device and the XCaliber processor. Part of this mechanism is to detect that the LPM 

5 is becoming full and, in this case, a NoMorePagesOGfsizelnt interrupt is generated to 
the SPU. The EPM is software controlled and, therefore, its state is not maintained by 
the PMMU hardware. 

The software can enable the NoMorePagesOfXTsizelnt interrupt by specifying a 
virtual page size s . Whenever the PMMU detects that no more available virtual pages 

10 of that size are available (i.e. FitsVectorfc] is de-asserted for all the blocks), the 
interrupt is generated. The larger the virtual page size selected, the sooner the 
interrupt will be generated. The size of the virtual page will be indicated with a 4-bit 
value (0:256 bytes, 1 :512 bytes, . . ., 8:64KB) in an on-the-fly configuration register 
IntKNoMoreThanA^izePages. When this value is greater than 8, the interrupt is never 

15 generated. 

If the smallest virtual page size is selected (256 bytes), the 
NoMorePagesOGfsizelnt interrupt is generated when the LPM is completely full (i.e. 
no more packets are accepted, not even a 1-byte packet). 

In general, if the Intf fNoMoreThanA r sizePages is X 9 the soonest the interrupt 

20 will be generated is when the local packet memory is (100/2*)% full. Note that, 

because of the atomic pages being 256 bytes, the LPM could become full with only 3 
K-bytes of packet data (3 byte per packet, each packet using an atomic page). 

Packet size mismatch 

25 

The PMMU keeps track of how many bytes are being uploaded into the LPM or 
EPM. If this size is different from the size specified in the first two bytes, a 
PacketErrorlnt interrupt is generated to the SPU. In this case the packet with the 
mismatch packet size is dropped (the already allocated atomic pages will be de- 
30 allocated and no packetPage will be created). No AutomaticDropInt interrupt is 

generated in this case. If the actual size is more than the size specified in the first two 
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bytes, the remaining packet data being received from the ASIC is gracefully 
discarded. 

When a packet size mismatch is detected on an inbound device identifier D (D = 
0,1), the following packets received from that same device identifier are dropped until 
software writes (any value) into a ClearErrorD configuration register. 

Bus Error Recovering 

Faulty packet data can arrive to or leave the PMU due to external bus errors. In 
particular the network input interface may notify that the 16-byte chunk of data sent in 
has a bus error, or the SIU may notify that the 16-byte chunk of data downloaded 
from EPM has a bus error. In both cases, the PMMU generates the PacketErrorlnt 
interrupt to notify the SPU about this event No other information is provided to the 
SPU. 

Note that if an error is generated within the LPM, it will not be detected since 
no error detection mechanism is implemented in this on-chip memory. Whenever a 
bus error arises, no more data of the affected packet will be received by the PMU, 
This is done by the SIU in both cases. For the first case the PMMU needs to de- 
allocate the already allocated atomic pages used for the packet data received previous 
to the error event 

When a bus error is detected on an inbound device identifier D (D = 0,1), the 
following packets received from that same device identifier are dropped until software 
writes (any value) into a ClearErrorZ) (D=0,1) configuration register. 

Queuing System (OS) 

The queueing system (QS) in the PMU of the XCaliber processor has functions 
of holding packet identifiers and the state of the packets currently in-process in the 
XCaliber processor, keeping packets sorted by their default or software-provided 
priority, selecting the packets that need to be pre-loaded (in the background) into one 
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of the available contexts, and selecting those processed packets that are ready to be 
sent out to an external device. 

Fig. 9 is a block diagram showing the high-level communication between the 
QS and other blocks in the PMU and SPU. When the PMMU creates a packetPage, it 
5 is sent to the QS along with a queue number and the device identifier. The QS 
enqueues that packetPage in the corresponding queue and associates a number 
(packetNumber) to that packet. Eventually, the packet is selected and provided to the 
RTU, which loads the packetPage, packetNumber and selected fields of the packet 
header into an available context. Eventually the SPU processes that context and 
10 communicates to the PMU, among other information, when the processing of the 
packet is completed or the packet has been dropped. For this communication, the 
SPU provides the packetNumber as the packet identifier. The QS marks that packet 
as completed (in the first case) and the packet is eventually selected for downloading 
from packet memory. 

15 It is a requirement in the instant embodiment (and highly desirable) that packets 

of the same flow (same source and destination) need to be sent out to the external 
device in the same order as they arrived to the XCaliber processor (unless software 
explicitly breaks this ordering). When the SPU begins to process a packet the flow is 
not known. Keeping track of the ordering of packets within a flow is a costly task 

20 because of the amount of processing needed and because the number of active flows 
can be very large, depending on the application. Thus, the order within a flow is 
usually kept track by using aggregated-flow queues. In an aggregated-flow queue, 
packet identifiers from different flows are treated as from the same flow for ordering 
purposes. 

25 The QS offloads the costly task of maintaining aggregated-flow queues by 

doing it in hardware and in the background. Up to 32 aggregated-flow queues can be 
maintained in the current embodiment, and each of these queues has an implicit 
priority. Software can enqueue a packetPage in any of the up to 32 queues, and can 
move a packetPage identifier from one queue to another (for example, when the 

30 priority of that packet is discovered by the software). It is expected that software, if 
needed, will enqueue all the packetPage identifiers of the packets that belong to the 
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same flow into the same queue. Otherwise, a drop in the performance of the network 
might occur, since packets will be sent out of order within the same flow. Without 
software intervention, the QS guarantees the per-flow order of arrival. 

5 Generic Queue 

The QS implements a set of up to 32 FIFO-like queues, which are numbered, in 
the case of 32 queues, from 0 to 3 1. Each queue can have up to 256 entries. The 
addition of all the entries of all the queues, however, cannot exceed 256. Thus, queue 
10 sizes are dynamic. A queue entry corresponds to a packetPage identifier plus some 
other information. Up to 256 packets are therefore allowed to be in process at any 
given time in the XCaliber processor. This maximum number is not visible to 
software. 

Whenever the QS enqueues a packetPage, a number (packetNumber) from 0 to 

15 255 is assigned to the packetPage. This number is provided to the software along 
with the packetPage value. When the software wants to perform an operation on the 
QS, it provides the packetNumber identifier. This identifier is used by the QS to 
locate the packetPage (and other information associated to the corresponding packet) 
in and among its queues. 

20 Software is aware that the maximum number of queues in the XCaliber 

processor is 32. Queues are disabled unless used. That is, the software does not need 
to decide how many queues it needs up front A queue becomes enabled when at least 
one packet is in residence in that queue. 

Several packet identifiers from different queues can become candidates for a 

25 particular operation to be performed. Therefore, some prioritization mechanism must 
exist to select the packet identifier to which an operation will be applied first. 
Software can configure (on-the-fly) the relative priority among the queues using an 
"on-the-fly" configuration register PriorityClusters. This is a 3-bit value that specifies 
how the different queues are grouped in clusters. Each cluster has associated a 

30 priority (the higher the cluster number, the higher the priority). The six different 
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modes in the instant embodiment into which the QS can be configured are shown in 
the table of Fig. 10. 

The first column of Fig. 10 is the value in the "on-the-fly" configuration register 
PriorityClusters. Software controls this number, which defines the QS configuration. 
5 For example, for PriorityClusters = 2, the QS is configured into four clusters, with 
eight queues per cluster. The first of the four clusters will have queues 0 through 7, 
the second cluster will have queues 8-15, the third clusters 16 through 23, and the last 
of the four clusters has queues 24 through 3 1 . 

Queues within a cluster are treated fairly in a round robin fashion. Clusters are 
10 treated in a strict priority fashion. Thus, the only mode that guarantees no starvation 
of any queue is when PriorityClusters is 0, meaning one cluster of 32 queues. 

Inserting a packetPage/deviceld into the QS 

15 Fig. 1 1 is a diagram illustrating the generic architecture of QS 21 1 of Figs. 2 

and 7 in the instant embodiment. Insertion of packetPages and Deviceld information 
is shown as arrows directed toward the individual queues (in this case 32 queues). 
The information may be inserted from three possible sources, these being the PMMU, 
the SPU and re-insertion from the QS. There exists priority logic, illustrated by 

20 function element 1 101 , for the case in which two or more sources have a packetPage 
ready to be inserted into the QS. In the instant embodiment the priority is, in 
descending priority order, the PMMU, the QS, and the SPU (software). 

Regarding insertion of packets from the SPU (software), the software can create 
packets on its own. To do so, it first requests a consecutive chunk of free space of a 

25 given size (see the SPU documentation) from the PMU, and the PMU returns a 
packetPage in case the space is found. The software needs to explicitly insert that 
packetPage for the packet to be eventually sent out. When the QS inserts this 
packetPage, the packetNumber created is sent to the SPU. Software requests an 
insertion through the Command Unit (see Fig. 2). 
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In the case of insertion from the QS, an entry residing at the head of a queue 
may be moved to the tail of another queue. This operation is shown as selection 
function 1103. 

In the case of insertion from the PMU, when a packet arrives to the XCaliber 

5 processor, the PMMU assigns a packetPage to the packet, which is sent to the QS as 
soon as the corresponding packet is safely stored in packet memory. 

An exemplary entry in a queue is illustrated as element 1 105, and has the 
following fields: Valid (1) validates the entry. PacketPage (16) is the first atomic 
page number in memory used by the packet NextQueue (5) may be different from 

10 the queue number the entry currently belongs to, and if so, this number indicates the 
queue into which the packetPage needs to be inserted next when the entry reaches the 
head of the queue. Delta (10) contains the number of bytes that the header of the 
packet has either grown or shrunk. This value is coded in 2's complement. 
Completed (1) is a single bit that indicates whether software has finished the 

15 processing of the corresponding packet Deviceld (2) is the device identifier 

associated to the packet. Before a Complete operation is performed on the packet 
(described below) the Deviceld field contains the device identifier of the external 
device that sent the packet in. After the Complete operation, this field contains the 
device identifier of the device to which the packet will be sent. Active (1) is a single 

20 bit that indicates whether the associated packet is currently being processed by the 
SPU. CRCtype (2) indicates to the network output interface which type of CRC, if 
any, needs to be computed for the packet. Before the Complete operation is 
performed on the packet, this field is 0. KeepSpace (1) specifies whether the atomic 
pages that the packet occupies in the LPM will be de-allocated (KeepSpace de- 

25 asserted) by the PMMU or not (KeepSpace asserted). If the packet resides in EPM 
this bit is disregarded by the PMMU. 

The QS needs to know the number of the queue to which the packetPage will be 
inserted. When software inserts the packetPage, the queue number is explicitly 
provided by an XStream packet instruction, which is a function of the SPU, described 

30 elsewhere in this specification. If the packetPage is inserted by the QS itself, the 
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queue number is the value of the NextQueue field of the entry where the packetPage 
resides. 

When a packetPage is inserted by the PMMU, the queue number depends on 
how the software has configured (at boot time) the Log2InputQueues configuration 
5 register. If Log2InputQueues is set to 0, all the packetPages for the incoming packets 
will be enqueued in the same queue, which is specified by the on-the-fly configuration 
register FirstlnputQueue. If Log2InputQueues is set to k (1 < = k < = 5), then the k 
MSB bits of the 3rd byte of the packet determine the queue number. Thus an external 
device (or the network input interface block of the SIU) can assign up to 256 priorities 

1 0 for each of the packets sent into the PMU. The QS maps those 256 priorities into 2*, 
and uses queue numbers FirstlnputQueue to FirstInputQueue+2M to insert the 
packetPages and deviceld information of the incoming packets. 

It is expected that an external device will send the same 5 MSB bits in the 3 rf 
byte for all packets in the same flow. Otherwise, a drop in the performance of the 

1 5 network might occur, since packets may be sent back to the external device out-of- 
order within the same flow. Software is aware of whether or not the external device 
(or SIU) can provide the information of the priority of the packet in the 3 rd byte. 

When packetPage p is inserted into queue q> the PacketPage field of the entry to 
be used is set to p and the Valid field to * 1 \ The value for the other fields depend on 

20 the source of the insertion. If the source is software (SPU), Completed is *0'; 
NextQueue is provided by SPU; Deviceld is '()'; Active is T; CRCtype is 0; 
KeepSpace is 0, and Probed is 0. 

If the source is the QS, the remaining fields are assigned the value they have in 
the entry in which the to-be-inserted packetPage currently resides. If the source is the 

25 PMMU, Completed is *0\ NextQueue is q, Deviceld is the device identifier of the 
external device that sent the packet into XCaliber, Active is *0\ CRCtype is 0, 
KeepSpace is 0, and Probed is 0. 
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Monitoring logic 

The QS monitors entries into all of the queues to detect certain conditions and to 
perform the corresponding operation, such as to re-enqueue an entry, to send a 
5 packetPage (plus some other information) to the PMMU for downloading, or to send a 
packetPage (plus some other information) to the RTU. 

All detections take place in a single cycle and they are done in parallel. 

Re-enqueuing an entry 

10 The QS monitors all the head entities of the queues to determine whether a 

packet needs to be moved to another queue. Candidate entries to be re-enqueued need 
to be valid, be at the head of a queue, and have the NextQueue field value different 
from the queue number of the queue in which the packet currently resides. 

If more than one candidate exists for re-enqueueing, the chosen entry will be 

15 selected following a priority scheme described later in this specification. 

Sending an entry to the PMMU for downloading 

The QS monitors all the head entities of the queues to determine whether a 
20 packet needs to be downloaded from the packet memory. This operation is 1 102 in 
Fig. 1 1 . The candidate entries to be sent out of XCaliber need to be valid, be at the 
head of the queue, have the NextQueue field value the same as the queue number of 
the queue in which the packet currently resides, and have the Completed flag asserted 
and the Active flag de-asserted. Moreover the QS needs to guarantee that no pending 
25 reads or writes exist from the same context that has issued the download command to 
the QS. 

If more than one candidate exists for downloading, the chosen entry will be 
selected following a priority scheme described later in this specification. 

A selected candidate will only be sent to the PMMU if the PMMU requested it. 
30 If the candidate was requested, the selected packetPage, along with the cluster number 
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from which it is extracted, the tail growth/shrink, the outbound device identifier bit, 
the CRCtype and the KeepSpace bits are sent to the PMMU. 

Fig. 12 is a table indicating coding of the Deviceid field. If the Deviceid field is 
0, then the Outbound Device Identifier is the same as the Inbound Device Identifier, 
5 and so on as per the table. 

When an entry is sent to the PMMU, the entry is marked as "being transmitted" 
and it is extracted from the queuing system (so that it does not block other packets 
that are ready to be transmitted and go to a different outbound device identifier). 
However, the entry is not invalidated until the PMMU notifies that the corresponding 
10 packet has been completely downloaded. Thus, probe-type operations on this entry 
will be treated as valid, i.e. as still residing in the XCaliber processor. 

Reincarnation effect 

15 As described above, the QS assigns a packetNumber from 0 to 255 (256 

numbers in total) to each packet that comes into XCaliber and is inserted into a queue. 
This is done by maintaining a table of 256 entries into which packet identifiers are 
inserted. At this time the Valid bit in the packet identifier is also asserted. Because 
the overall numbers of packets dealt with by XCaliber far exceeds 256, packet 

20 numbers, of course, have to be reused throughout the running of the XCaliber 

processor. Therefore, when packets are selected for downloading, at some point the 
packetNumber is no longer associated with a valid packet in process, and the number 
may be reused. 

As long as a packet is valid in XCaliber it is associated with the packetNumber 
25 originally assigned. The usual way in which a packetNumber becomes available to be 
reused is that a packet is sent by the QS to the RTU for preloading in a context prior 
to processing. Then when the packet is fully processed and fully downloaded from 
memory, the packet identifier in the table associating packetNumbers is marked 
Invalid by manipulating the Valid bit (see Fig. 1 1 and the text accompanying). 
30 In usual operation the system thus far described is perfectly adequate. It has 

been discovered by the inventors, however, that there are some situations in which the 
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Active and Valid bits are not sufficient to avoid contention between streams. One of 
these situations has to do with a clean-up process, sometimes termed garbage 
collection, in which software monitors all packet numbers to determine when packets 
have remained in the system too long, and discards packets under certain conditions, 

5 freeing space in the system for newly-arriving packets. 

In these special operations, like garbage collection, a stream must gain 
ownership of a packet, and assure that the operation it is to perform on the packet 
actually gets performed on the correct packet. As software probes packets, however, 
and before action may be taken, because there are several streams operating, and 

1 0 because the normal operation of the system may also send packets to the RTU, for 
example, it is perfectly possible in these special operations that a packet probed may 
be selected and effected by another stream before the special operation is completed. 
A packet, for example, may be sent to the RTU, processed, and downloaded, and a 
new packet may then be assigned to the packetNumber, and the new packet may even 

15 be stored at exactly the same packetPage as the original packet. There is a danger, 

i 

then, that the special operations, such as discarding a packet in the garbage collection 
process, may discard a new and perfectly valid packet, instead of the packet originally 
selected to be discarded. This, of course, is just one of potentially many such special 
operations that might lead to trouble. 

20 Considering the above, the inventors have provided a mechanism for assuring 

that, given two different absolute points in time, time s and time r, for example, that a 
valid packetNumber at time s and the same packetNumber at time r, still is associated 
to the same packet. A simple probe operation is not enough, because at some time 
after s and before time r the associated packet may be downloaded, and another (and 

25 different) packet may have arrived, been stored in exactly the same memory location 
as the previous packet, and been assigned the same packetNumber as the downloaded 
packet 

The mechanism implemented in XCaliber to ensure packetNumber association 
with a specific packet at different times includes a probe bit in the packet identifier. 
30 When a first stream, performing a process such as garbage collection, probes a packet, 
a special command, called Probe&Set is used. Probe&Set sets (asserts) the probe bit, 
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and the usual information is returned, such as the value for the Valid bit, the Active 
bit, the packetPage address, and the old value of the probe bit. The first stream then 
executes a Conditional Activate instruction, described elsewhere in this specification, 
to gain ownership of the packet. Also, when the queuing system executes this 

5 Conditional Activate instruction it asserts the active bit of the packet. Now, at any 
time after the probe bit is set by the first stream, when a second stream at a later time 
probes the same packet, the asserted probe bit indicates that the first stream intends to 
gain control of this packet. The second stream now knows to leave this packet alone. 
This probe bit is de-asserted when a packet enters the XCaliber processor and a new 

10 (non-valid) number is assigned. 

Sending an entry to the RTU 

The RTU uploads in the SPU background to the XCaliber processor some fields 
of the headers of packets that have arrived, and have been completely stored into 
15 packet memory. This uploading of the header of a packet in the background may 
occur multiple times for the same packet. The QS keeps track of which packets need 
to be sent to the RTU. The selection operation is illustrated in Fig. 1 1 as 1 104. 

Whenever the RTU has chosen a context to pre-load a packet, it notifies the QS 
that the corresponding packet is no longer an inactive packet The QS then marks the 
20 packet as active. 

Candidate entries to be sent to the RTU need to be valid, to be the oldest entry 
with the Active and Completed bits de-asserted, to have the NextQueue field value the 
same as the queue number of the queue in which the packet currently resides, and to 
conform to a limitation that no more than a certain number of packets in the queue in 
25 which the candidate resides are currently being processed in the SPU. More detail 
regarding this limitation is provided later in this specification. When an entry is sent 
to the RTU for pre-loading, the corresponding Active bit is asserted. 

A queue can have entries with packet identifiers that already have been 
presented to the RTU and entries that still have not. Every queue has a pointer 
30 (NextPacketForRTU) that points to the oldest entry within that queue that needs to be 
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sent to the RTU. Within a queue, packet identifiers are sent to the RTU in the same 
order they were inserted in the queue. 

The candidate packet identifiers to be sent to the RTU are those pointed to by 
the different NextPacketForRTU pointers associated with the queues. However, some 

5 of these pointers might point to a non-existent entry (for example, when the queue is 
empty or when all the entries have already been sent to the RTU). The hardware that 
keeps track of the state of each of the queues determines these conditions. Besides 
being a valid entry pointed to by a NextPacketForRTU pointer, the candidate entry 
needs to have associated with it an RTU priority (described later in this specification) 

10 currently not being used by another entry in the RTU. If more than a single candidate 
exists, the chosen entry is selected following a priority scheme described later in this 
specification. 

As opposed to the case in which an entry is sent to the PMMU for downloading, 
an entry sent to the RTU is not extracted from its queue. Instead, the corresponding 
15 NextPacketForRTU pointer is updated, and the corresponding Active bit is asserted. 

The QS sends entries to an 8-entry table in the RTU block as long as the entry is 
a valid candidate and the corresponding slot in the RTU table is empty. The RTU will 
accept, at most, 8 entries, one per each interrupt that the RTU may generate to the 
SPU. 

20 The QS maps the priority of the entry (given by the queue number where it 

resides) that it wants to send to the RTU into one of the 8 priorities handled by the 
RTU (RTU priorities). This mapping is shown in the table of Fig. 13, and it depends 
on the number of clusters into which the different queues are grouped (configuration 
register PriorityClusters) and the queue number in which the entry resides. 

25 The RTU has a table of 8 entries, one for each RTU priority. Every entry 

contains a packet identifier (packetPage, packetNumber, queue#) and a Valid bit that 
validates it. The RTU always accepts a packet identifier of RTU priority p if the 
corresponding Valid bit in entry p of that table is de-asserted. When the RTU receives 
a packet identifier of RTU priority p from the QS, the Valid bit of entry p in the table 

30 is asserted, and the packet identifier is stored. At that time the QS can update the 
corresponding NextPacketForRTU pointer. 
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Limiting the packets sent within a queue 

Software can limit the number of packets that can be active (i.e. being processed 
by any of the streams in the SPU) on a per-queue basis. This is achieved through a 
5 MaxActivePackets on-the-fly configuration register, which specifies, for each queue, 
a value between 1 and 256 that corresponds to the maximum number of packets, 
within that queue, that can be being processed by any stream. 

The QS maintains a counter for each queue q which keeps track of the current 
number of packets active for queue q. This counter is incremented whenever a packet 

1 0 identifier is sent from queue q to the RTU, a Move operation moves a packet into 
queue q, or an Insert operation inserts a packet identifier into queue q\ and 
decremented when any one the following operations are performed in any valid entry 
in queue q \ a Complete operation, an Extract operation, a Move operation that moves 
the entry to a different queue, or a MoveAndReactivate operation that moves the entry 

15 to any queue (even to the same queue). Move, MoveAndReactivate, Insert, Complete 
and Extract are operations described elsewhere in this specification. 

Whenever the value of the counter for queue q is equal to or greater than the 
corresponding maximum value specified in the MaxActivePackets configuration 
register, no entry from queue q is allowed to be sent to the RTU. The value of the 

20 counter could be greater since software can change the MaxActivePackets 

configuration register for a queue to a value lower than the counter value at the time 
of the change, and a queue can receive a burst of moves and inserts. 

Software operations on the QS 

25 

Software executes several instructions that affect the QS. The following is a 
list of all operations that can be generated to the QS as a result of the dispatch by the 
SPU core of an XStream packet instruction: 

Insert(p,?); <he packetPage p is inserted into queue q. A 4 V will be returned to 
30 the SPU if the insertion was successful, and a '0* if not. The insertion will be 
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unsuccessfol only when no entries are available (i.e. when all the 256 entries are 
valid). 

Move(n,q): asserts to q the NextQueue field of the entry in which 
packetNumber n resides. 
5 MoveAndReactivate(n^): asserts to q the NextQueue field of the entry in 

which packetNumber n resides; de-asserts the Active bit. 

CompIete(/i,tf,£): asserts the Completed flag, the Delta field to d and the 
deviceld field to e of the entry in which packetNumber n resides. De-asserts the 
Active bit and de-asserts the KeepSpace bit 
10 CompleteAndKeepSpace(«,</,£?): same as CompIeteO but it asserts the 

KeepSpace bit. 

Extract(n): resets the Valid flag of the entry in which packetNumber n 

resides. 

Replace(/i,/?): the PacketPage field of the entry in which packetNumber n 
1 5 resides is set to packetPage /?. 

Probe(n): the information whether the packetNumber n exists in the QS or not 
is returned to the software. In case it exists, it returns the PacketPage, Completed, 
NextQueue, Deviceld, CRCtype, Active, KeepSpace and Probed fields. 

ConditionalActivate(/i): returns a ' V if the packetNumber n is valid, Probed 
20 is asserted, Active is de-asserted, and the packet is not being transmitted. In this case, 
the Active bit is asserted. 

The QS queries the RTU to determine whether the packet identifier of the 
packet to be potentially activated is in the RTU table, waiting to be preloaded, or 
being preloaded. If the packet identifier is in the table, the RTU invalidates it. If the 
25 query happens simultaneously with the start of preloading of that packet, the QS does 
not activate the packet. 

ProbeAndSet(w): same as ProbeO but it asserts the Probed bit (the returned 
Probed bit is the old Probed bit). 

Probe(?): provides the size (i.e. number of valid entries) in queue q. 

30 
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A MoveO, MoveAndReactivateO, CompleteO, CompleteAndKeepSpaceO, 
ExtractO and Replace() on an invalid (i.e. non-existing) packetNumber is disregarded 
{no interrupt is generated). 

5 A Move, MoveAndReactivate, Complete, CompleteAndKeepSpace, Extract and 

Replace on a valid packetNumber with the Active bit de-asserted should not happen 
(guaranteed by software). If it happens, results are undefined. Only the Insert, Probe, 
ProbeAndSet and ConditionalActivate operations reply back to the SPU. 

If software issues two move-like operations to the PMU that affect the same 
1 0 packet, results are undefined, since there is no guarantee that the moves will happen as 
software specified. 

Fig. 14 is a table showing allowed combinations of Active, Completed, and 
Probed bits for a valid packet. 



1 5 Basic operations 

To support the software operations and the monitoring logic, the QS implements 
the following basic operations: 

1 . Enqueue an entry at the tail of a queue. 
20 2. Dequeue an entry from the queue in which it resides. 

3. Move an entry from the head of the queue wherein it currently resides to the 
tail of another queue. 

4. Provide an entry of a queue to the RTU. 

5. Provide the size of a queue. 

25 6. Update any of the fields associated to packetNumber. 

Operations 1, 2, 4 and 6 above (applied to different packets at the same time) 
are completed in 4 cycles in a preferred embodiment of the present invention. This 
implies a throughput of one operation per cycle. 

30 
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Some prioritization is necessary when two or more operations could start to be 
executed at the same time. From highest to lowest priority, these events are inserting 
from the PMMU, dequeuing an entry, moving an entry from one queue to another 
queue, sending an entry to the RTU for pre-loading, or a software operation. The 
5 prioritization among the software operations is provided by design since software 
operations are always executed in order. 

Early QS full detection 

1 0 The PMU implements a mechanism to aid in flow control between the ASIC 

(see element 203 in Fig. 2) and the XCaliber processor Part of this mechanism is to 
detect that the QS is becoming full and, in this case, a LessThanXpacketldEntriesInt 
interrupt is generated to the SPU. The software can enable this interrupt by specifying 
(in a IntlfLessThanXpacketldEntries configuration register) a number z larger than 0. 

1 5 An interrupt is generated when 256-y < z, being y the total number of packets 
currently in process in XCaliber. When 2 = 0, the interrupt will never occur. 

Register Transfer Unit (RTU) 

20 A goal of the RTU block is to pre-load an available context with information of 

packets alive in XCaliber. This information is the packetPage and packetNumber of 
the packet and some fields of its header. The selected context is owned by the PMU at 
the time of the pre-loading, and released to the SPU as soon as it has been pre-loaded. 
Thus, the SPU does not need to perform the costly load operations to load the header 

25 information and, therefore, the overall latency of processing packets is reduced. 

The RTU receives from the QS a packet identifier (packetPage, packetNumber) 
and the number of the queue from which the packet comes from) from the QS. This 
identifier is created partly by the PMMU as a result of a new packet arriving to 
XCaliber through the network input interface (packetPage), and partly by the QS 

30 when the packetPage and device identifier are enqueued (packetNumber). 
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Another function of the RTU is to execute masked load/store instructions 
dispatched by the SPU core since the logic to execute a masked load/store instruction 
is similar to the logic to perform a pre-load. Therefore, the hardware can be shared for 
both operations. For this reason, the RTU performs either a masked load/store or a 
5 pre-load, but not both, at a time. The masked load/store instructions arrive to the 
RTU through the command queue (CU) block. 

Context States 

10 A context can be in one of two states: PMU-owned or SPU-owned. The 

ownership of a context changes when the current owner releases the context. The ~ 
PMU releases a context to the SPU in three cases. Firstly, when the RTU has finished 
pre-loading the information of the packet into the context. Secondly, the PMU 
releases a context to the SPU when the SPU requests a context to the RTU. In this 

15 case, the RTU will release a context if it has one available for releasing. Thirdly, all 
eight contexts are PMU-owned. Note that a context being pre-loaded is considered to 
be a PMU-owned context 

The SPU releases a context to the RTU when the SPU dispatches an XStream 
RELEASE instruction. 

20 

Pre-loading a Context 

At boot time, the PMU owns 7 out of the 8 contexts that are available in the 
embodiment of the invention described in the present example, and the SPU owns one 

25 context. The PMU can only pre-load information of a packet to a context that it owns. 
The process of pre-loading information of a packet into a context is divided into two 
steps. A first phase to load the address (the offset within the packet memory address 
space), from where the packet starts. This offset points to the first byte of the two- 
byte value that codes the size in bytes of the packet. In the case that the packet has 

30 been time stamped and HeaderGrowthOffset is not 0, the time stamp value is located 
at offset-4. The offset address is computed as (packetPage « 8) | 
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(HeaderGrowthOffset « 4). This offset is loaded into register number 
StartLoadingRegister in the selected context. StartLoadingRegister is a boot-time 
configuration register. The packetNumber value is loaded in register number 
StartLoadingRegisterf 1 . 
5 The second phase is to load the packet header. The packet header is loaded 

using registers StartLoadingRegisteri-2, StartLoadingRegisteH-3, ... (as many as 
needed, and as long as there exist GPR registers). The PatternMatchingTable^] (g 
being the queue number associated to the packet) mask specifies how the header of 
the packet will be loaded into the GPR registers of the context. The 

1 0 PatternMatchingTable is an on-the-fly configuration register that contains masks. To 
obtain the header data, the RTU requests the SIU to read as many 16-byte lines of 
packet data as needed into the packet memory. The RTU, upon receiving the 1 6-byte 
lines from packet memory (either local or external), selects the desired bytes to load 
into the context using pattern mask to control this operation. 

1 5 The step described immediately above of loading the packet header may be 

disabled by software on a per-queue basis through the on-the-fly PreloadMaskNumber 
configuration register. This register specifies, for each of the 32 possible queues in 
the QS, which mask (from 0 to 23) in the PatternMatchingTable is going to be used 
for the pre-loading. If a value between 24 and 3 1 is specified in the configuration 

20 register, it is interpreted by the RTU as not to perform. 

The RTU only loads the GPR registers of a context. The required CPO registers 
are initialized by the SPU. Since the context loaded is a PMU-owned context, the 
RTU has all the available write ports to that context (4 in this embodiment) to perform 
the loading. 

25 Whenever the pre-loading operation starts, the RTU notifies this event to the 

SPU through a dedicated interface. Similarly, when the pre-loading operation is 
completed, the RTU also notified the SPU. Thus the SPU expects two notifications 
(start and end) for each packet pre-load. A special notification is provided to the SPU 
when the RTU starts and ends a pre-load in the same cycle (which occurs when the 

30 step of loading packet header is disabled). In all three cases, the RTU provides the 
context number and the contents of the CodeEntryPoint configuration register 
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associated to the packet. In the case that the PMU releases a context to the SPU 
because all eight contexts are PMU-owned, the contents of the CodeEntryPointSpecial 
are provided to the SPU. The RTU has an 8-entry table (one for each context), each 
entry having a packet identifier ready to be pre-loaded and a valid bit that validates the 

5 entry. The RTU selects always the valid identifier of the highest entry index to do the 
pre-load. When a context is associated to this identifier, the corresponding valid bit is 
de-asserted. The RTU pre-loads one context at a time. After loading a context, the 
context is released to the SPU and becomes a SPU-owned context. At this point the 
RTU searches its table for the next packet to be pre-loaded into a context (in case 

1 0 there is at leas one PMU-owned context). 

Pattern-Matching Table 

Figure 15 illustrates a Pattern Matching Table which is an on-the-fly 
configuration register that contains a set of sub-masks. The RTU can use any sub- 

1 5 mask (from 0 to 23) within this table for a pre-loading a context Sub-masks can also 
be grouped into a larger mask containing two or more submasks. 

Fig. 16 illustrates the format of a mask. A mask is a variable number (1 to 8) of 
sub-masks of 32x2 bits each, as shown. Every sub-mask has an associated bit 
(EndOfMask) that indicates whether the composite mask finishes with the 

20 corresponding sub-mask, or it continues with the next sub-mask. The maximum total 
number of sub-masks is 32, out of which 24 (sub-mask indexes 0 to 23) are global, 
which means any stream in the SPU can use and update them, and 8 are per-stream 
sub-masks. The per-stream sub-masks do not have an EndOfMask bit, which is 
because no grouping of per-stream sub-masks is allowed. 

25 The two 32-bit vectors in each sub-mask are named SelectVector and 

RegisterVector. The SelectVector indicates which bytes from the header of the packet 
will be stored into the context. The RegisterVector indicates when to switch to the 
next consecutive register within the context to keep storing the selected bytes by the 
SelectVector. The bytes are always right aligned in the register. 

30 Fig. 17 shows an example of a pre-load operation using the mask in Fig. 16. A 

bit asserted in the SelectVector indicates that the corresponding byte of the header are 
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stored into a register. In the example, bytes 0, 1 and 7 of the header are loaded into 
GPR number StartLoadingRegister +2 in bytes 0, 1 and 2, respectively (i.e. the header 
bytes are right-aligned when loaded into the register). A bit asserted in the 
RegisterVector indicates that no more header bytes are loaded into the current GPR 
5 register, and that the next header bytes, if any, are loaded into the next (consecutively) 
GPR register. In the example, bytes 12 and 13 of the header are loaded into GPR 
number StartLoadingRegister+3. 



Selecting a PMU-owned Context 

10 

There are a total of eight functional units in the SPU core. However, due to 
complexity-performance tradeoffs, a stream (context) can only issue instructions to a 
fixed set of 4 functional units. 

The RTU may own at any given time several contexts. Therefore, logic is 

15 provided to select one of the contexts when a pre-load is performed, or when a context 
has to be provided to the SPU. This logic is defined based on how the different 
streams (contexts) in the SPU core can potentially dispatch instructions to the 
different functional units, and the goal of the logic is to balance operations that the 
functional units in the SPU can potentially receive. 

20 The selection logic takes as inputs eight bits, one per context, that indicates 

whether that context is PMU or SPU-owned. The logic outputs which PMU-owned 
contexts) that can be selected. 



1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,3,20,5,6,7,24,9,10,11,12, 
25 13,14,15,32,33,34,3,36,5,6,7,40,9,10,11,12,13,14,15,48,48,48,51,48,53, 

54,7,48,57,58,11,60,13,14,15,64,65,66,3,68,5,6,7,72,9,10,11,12,13,14, 

15,80,80,80,83,80,85,86,7,80,89,90,11,92,13,14,15,96,96,96,99,96,101, 

102,7,96,105,106,1 1,108,13,14,15,1 12,1 12,1 12,1 12,1 12,1 12,1 12,1 19,1 12, 

1 12,1 12,123,1 12,125,126,15,128,129,130,3,132,5,6,7,136,9,10,1 1,12,13, 
30 14,15,144,144,144,147,144,149,150,7,144,153,154,11,156,13,14,15,160, 

160,160,163,160,165,166,7,160,169,170,11,172,13,14,15,176,176,176,176, 

176,176,176,183,176,176,176,187,176,189,190,15,192,192,192,195,192,197,198,7,192^0U02,U,20 
4,13,14,15,208,208,208,208,208,208,208,215,208, 

208,208,219,208,221,222,15,224,224^24^24,224,224,224,231,224,224^24,235^24,237,238,15,240, 
35 240,240,240,240,240,240,240,240,240,240,240,240,240,240 
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The selection logic is specified with the previous list of 254 numbers. Each 
number is associated to a possible combination of SPU/PMU-owned context. For 
example, the first number corresponds to the combination '0000000 \\ i.e. context 
hunlber 0 is PMU owned and context numbers 1 to 7 are SPU owned (LSB digit 

5 corresponds to context 0, MSB digit to context 7; digit value of 0 means SPU owned, 
digit value of 1 means PMU owned). The second number corresponds to combination 
'00000010', the third to combination '0000001 1 \ and so forth up to combination 
* 1 1 1 1 1 1 10\ The 19 lh combination ('0001001 1 ') has associated number 3 (or 
'0000001 F) in the previous list, which means that context 0 and 1 can be selected. 

10 Context 4 could also be selected, however it is not the best choice to balance the use 
of the functional units in the SPU core. 

Interrupt when no context is available 

15 The RTU has a table of 8 entries named NewPacketldTable). Entry p in this 

table contains a packet identifier (packetPage, packetNumber and queue number) with 
an RTU-priority ofp 9 and a Valid bit that validates the identifier. When the RTU is 
not busy pre-loading or executing a masked load/store, it will obtain from this table 
the valid identifier with the highest RTU-priority. In case it exists and there is at least 

20 one PMU-owned context, the RTU will start the pre-loading of a PMU-owned 
context, and it will reset the Valid bit in the table. 

In case there is no PMU-owned context, the RTU sits idle (assuming no 
software operation is pending) until a context is released by the SPU. At that point in 
time the RTU obtains, again, the highest valid RTU-priority identifier from the 

25 NewPacketldTable (since a new identifier with higher RTU priority could have been 
sent by the QS while the RTU was waiting for a context to be released by the SPU). 
The Valid bit is reset and the packet information starts being pre-loaded into the 
available context. At this point the RTU is able to accept a packet with RTU priority 
p from the QS. 

30 When an identifier with a RTU priority of p is sent by the QS to the RTU, it is 

loaded in entry p in the NewPacketldTable, and the Valid bit is set. At this time, if 



WO 03/005645 



PCT/US02/20316 



-53- 

the number of valid identifiers (without counting the incoming one) in the 
NewPacketldTable is equal or larger than the current available PMU-owned contexts 
(without counting the context that the RTU currently might be loading), then a 
PacketAvailableButNoContextPriorityP Int interrupt is generated to the SPU. P 

5 ranges from 0 to 7, and its value is determined by a boot-time configuration flag 
PacketAvailableButNo ContextlntMapping. If this flag is c 0\ P is determined by the 
3-bit boot-time configuration register DefaultPacketPriority. If this flag is 4 T, P is the 
RTU priority. However, the PacketAvailableButNoContextPriorityPint will not be 
generated if the corresponding configuration flag PacketAvailableButNo 

10 ContextPriorityPintEnable is de-asserted. 

The SPU, upon receiving the interrupt, decides whether or not to release a 
context that it owns so that (he RTU can pre-load the packetPage, packetNumber and 
header information of the new packet. 

When the RTU generates a PacketAvailableButNoContext PriorityPInt 

15 interrupt, it may receive after a few cycles a context that has been released by the 
SPU. This context, however, could have been released when, for example, one of the 
streams finished the processing of a packet This can happen before the interrupt 
service routine for the PacketAvailable ButNoContextPriorityPInt interrupt finishes. 
Thus, when a context is released due to the ISR completion, the packet pre-load that 

20 originated the interrupt already might have used the context first released by another 
stream in the SPU. Thus, the context released due to the interrupt will be used for 
another (maybe future) packet pre-load. If no other entry is valid in the 
NewPacketldTable, the context is be used and sits still until either an identifier arrives 
to the RTU or the SPU requesting a context to the RTU. 

25 Whenever a context becomes SPU-owned, and the RTU has a pre-load pending, 

the RTU selects the most priority pending pre-load (which corresponds to the highest- 
valid entry in the NewPacketTable), and will start the preload. If the 
PacketAvailableButNoContextPriorityint interrupt associated to this level was 
asserted, it gets de-asserted when the pre-load starts. 

30 
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Software Operations on the RTU 

Software executes a number of instructions that affect the RTU. Following is a 
5 list of all operations that can be generated to the RTU as a result of dispatch by the 
SPU core of an XStream packet instruction. The operations arrive to the RTU 
through the command queue (CU), along with the context number associated to the 
stream that issued the instruction: 

10 1 . Release(c): context number c becomes PMU owned. 

2, GetContext: the RTU returns the number of a PMU-owned context number. This 
context, if it exists, becomes SPU owned and a success flag is returned asserted; 
otherwise it is return de-asserted, in which case the context number is meaningless. 

15 

3. MaskedLoad(r,a,m), MaskedStore(r,a,m): the SPU core uses the RTU as a special 
functional unit to execute the masked load/store instructions since the logic to execute 
a masked load/store instruction is similar to the logic to perform a pre-load. 
Therefore, the hardware can be shared for both operations. For this reason, the RTU 

20 performs either a masked load/store or a pre-load, but not both at a time. For either the 
masked load or masked store, the RTU will receive the following parameters: 

(a) A mask number m that corresponds to the index of the first submask in the 
PatternMatchingTable to be used by the masked load/store operation. 

(b) A 36-bit address a that points to the first byte in (any) memory to which 
25 the mask will start to be applied. 

(c) A register number r (within the context number provided) that corresponds 
to the first register involved in the masked load/store operation. Subsequent 
registers within the same context number will be used according to the 
selected mask. 

30 For masked load/store operations, the mask can start to be applied at any byte 

of the memory, whereas in a pre-load operation (a masked-load like operation) the 
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mask will always be applied starting at a 16-byte boundary address since packet data 
coming from the network input interface is always stored in packet memory starting at 
the LSB byte in a 16-byte line. 

The MaskedLoad, MaskedStore and GetContext operations communicate to the 
5 SPU when they complete through a dedicated interface between the RTU and the 
SPU. The RTU gives more priority to a software operation than packet pre-loads. 
Pre-loads access the packet memory whereas the masked load/store may access any 
memory in the system as long as it is not cacheable or write-through. If not, results are 
undefined. 

10 The RTU is able to execute a GetContext or Release command while executing 

a previous masked load/store command. 

Programming Model 

1 5 Software can configure, either at boot time or on the fly, several of the features 

of the PMU. All of the features configurable at boot time only, and some 
configurable on the fly, must happen only when the SPU is running in a single-stream 
mode. If not, results are undefined. The PMU does not check in which mode the SPU 
is running. 

20 Software can update some of the information that the PMU maintains for a 

given packet, and also obtain this information. This is accomplished by software 
through new XStream packet instructions that are the subject of separate patent 
applications. These instructions create operations of three different types (depending 
on which block of the PMU the operation affects, whether PMMU, QS or RTU) that 

25 will be executed by the PMU. Some of the operations require a result from the PMU 
to be sent back to the SPU. 

The packet memory and configuration space are memory mapped. The SIU 
maintains a configuration register (16MB aligned) with the base address of the packet 
memory, and a second configuration register with the base address of EPM. Software 

30 sees the packet memory as a contiguous space. The system, however, allows the EPM 
portion of the packet memory to be mapped in a different space. 
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The SIU also maintains a third configuration register with the base of the PMU 
configuration register space. All the load/store accesses to LPM and configuration 
space performed by the SPU reach the PMU through the SIU. The SIU determines to 
which space the access belongs, and lets the PMU know whether the access is to LPM 
5 or to the PMU configuration space. Accesses to the EPM are transparent to the PMU. 

The PMU can interrupt the SPU when certain events happen. Software can 
disable all these interrupts through configuration registers. 

Configuration Registers 

10 

The configuration registers of the PMU reside in the PMU Configuration Space 
of the XCaliber address space. The base address of this space is maintained by the 
SIU and does not need to be visible by the PMU. The SIU notifies to the PMU with a 
signal when a read/write access performed by the SPU belongs to this space, along 

15 with the information needed to update the particular register on a write access. 

Some of the PMU configuration registers can be configured only at boot time, 
and some can be configured on the fly. All boot-time configurable and some on-the- 
fly configurable registers need to be accessed in single-stream mode. A boot-time 
configurable register should only be updated if the PMU is in reset mode. Results are 

20 undefined otherwise. The PMU will not check whether the SPU is indeed in single- 
stream mode when a single-stream mode configuration register is updated. All the 
configuration registers come up with a default value after the reset sequence. 

In the instant embodiment 4KB of the XCaliber address space is allocated for 
the PMU configuration space. In XCaliber' s PMU, some of these configuration 

25 registers are either not used or are sparsely used (i.e. only some bits of the 32-bit 
configuration register word are meaningful). The non-defined bits in the PMU 
configuration space are reserved for future PMU generations. Software can read or 
write these reserved bits but their contents, although fully deterministic, are 
undefined. 

30 Fig. 18 shows the PMU Configuration Space, which is logically divided into 32- 

bit words. Each word or set of words contains a configuration register. 
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Figs. 19a and 19b are two parts of a table showing mapping of the different 
PMU configuration registers into the different words of the configuration space. The 
block owner of each configuration register is also shown in the table. 

Following is the list of all configuration registers in this particular embodiment 
5 along with a description and the default value (after PMU reset). For each of the 
configuration registers, the bit width is shown in parenthesis. Unless otherwise 
specified, the value of the configuration register is right aligned into the 
corresponding word within the configuration space. 



1 0 Boot-time Only Configuration Registers : 

1 . Log2InputQueues (5) 

(a) Default Value: 0 

(b) Description: Number of queues in the QS used as input queues (i.e. number 
15 of queues in which packetPages/devicelds from the PMMU will be inserted). 

2. PriorityCIustering (3) 

(a) Default Value: 5 (32 clusters) 

(b) Description: Specifies how the different queues in the QS are grouped in 
20 priority clusters (0: 1 cluster, 1 : 2 clusters, 2: 4 clusters, . . ., 5: 32 clusters). 

3. HeaderGrowthOffset (4) 

(a) Default Value: 0 

(b) Description: Number of empty 16-byte chunks that will be left in front of 
25 the packet when it is stored in packet memory. Maximum value is 1 5 16-byte 

chunks. Minimum is 0. 

4. TailGrowthOffeet (6) 

(a)Default Value: 0 
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(b) Description: Number of empty 16-byte chunks that will be left at the end of 
the packet when it is stored in packet memory. Maximum value is 63 16-byte 
chunks. Minimum is 0, 

5 5.PacketAvailableButNoContextIntMapping(l) 

(a) Default Value: 0 

(b) Description: Specifies the P in the 

PacketAvailableButNoContextPriorityPInt interrupt, if enabled. The possible 
values are: 

10 (1) 0: P is specified by the DefaultPacketPriority register. 

(2) 1 : Pis the RTU priority. 

6. StartLoadingRegister (5) 

(a) Default Value: 1 

(b) Description: Determines the first GPR register number to be loaded by the 
RTU when performing the background load of the packet header on the chosen 
context. In this register, the value (packetPage « 8) | (HeaderGrowthOffset 
« 4) is loaded. The packetNumber is loaded in the next GPR register. The 
following GPR registers will be used to pre-load the packet header data 
following PatternMatchingMaskO mask if this feature is enabled. 

7. PreloadMaskNumber (32x5) 

(a) Default Value: mask 31 for all queues (i.e. pre-load of header is disabled). 

(b) Description: It specifies, for each of the 32 possible queues in the QS, which 
25 mask in the PatternMatchingTable is going to be used for pre-loading. 

Figs. 19a-c show a mapping of the PreloadMaskNumber configuration register. 

30 

The configuration registers described above are the boot-time-only 
configuration registers in the instant example. Immediately below are listed the On- 
The-Fly configuration registers. 



15 



20 
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Single-stream Configuration Registers 

l.OverflowEnable(l) 

5 (a) Default Value: 0 

(b) Description: Enables/disables the overflow of packets in case they do not 
fit into LPM. When disabled, these packets are dropped. 

2. PatternMatchingTable (24x(32x2+l) 
10 (a) Default Value (per each of the 24 entries): 

(1) SelectVector: select all bytes 

(2) RegisterVector: store 4 consecutive bytes per register 

(3) EndOfMask: 1 

(b) Description: It specifies, for masked load/store operations, which bytes to 

1 5 load/store and in which (consecutive) registers. Mask 0 of this table is used by 

the RTU to pre-load, in the background, some bytes of the header of the packet 
in one of the available contexts. There are a total of 24 masks. 

(c) Note : Mask 0 needs to be written when the PMU is freezed (see Section 0), 
otherwise results are undefined. 

20 

Fig. 21 illustrates the PatternMatchingTable described immediately above. 



3. Freeze (1) 
25 (a) Default Value: 1 

(b) Description: Enables/disables the freeze mode. 



4. Reset (1) 

(a) Default Value: 0 

30 (b) Description: When set to^ 1, forces the PMU to perform the reset sequence. 

All packet data in the PMU will be lost. After the reset sequence all the 
configuration registers will have the default values. 
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Multi-stream Configuration Registers 

LClearError£>(£> = 0,l) 
5 (a) Default Value: 0 

(b) Description: When written by software (with any data), the packet error 
condition detected on device identifier D is cleared. 

2. PacketAvailableButNoContextPriorityPintEnable (8) [P= 0..7] 
10 (a) Default Value: 0 (for all levels) 

(b) Description: Enables/disables the 
PacketAvailableButNoContextPriorityPint interrupt. 

3. AutomaticPacketDropIntEnable (1) 
15 (a) Default Value: 1 

(b) Description: Enables/disables the AutoraaticPacketDropInt interrupt. 

4. TimeStampEnable (1) 

(a) Default Value: 0 

20 (b) Description: Enables/disables the time stamp of packets. When enabled 

and HeaderGrowthOffset is greater than 0, a 4-byte time stamp is appended to 
the packet before it is written into the packet memory, 

5. PacketErrorlntEnable (1) 
25 (a) Default Value: 0 

(b) Description: Enables/disables the PacketErrorlnt interrupt. 

6. VirtualPageEnable (9x4) 

(a) Default Value: all virtual pages enabled for all blocks. 
30 (b) Description: Enables/disables the virtual pages for each of the 4 blocks that 

the LPM is divided into. There are up to 9 virtual pages, from 256 bytes 
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(enabled by the LSB bit) up to 64K bytes (enabled by the MSB bit), with all 
power-of-two sizes in between. 

Fig. 22 illustrates the VirtualPageEnable register. 

5 

7. Overflow Address (24) 

(a) Default Value: 0x40000 (the first atomic page in the EPM) 

(b) Description: the 16 MSB bits correspond to the atomic page number in 
packet memory into which the packet that is overflowed will start to be stored. 

10 The 8 LSB are hardwired to *0* (i.e. any value set by software to these bits 

will be disregarded). OverflowAddress is then the offset address within the 
16MB packet memory. The SIU will translate this offset into the 
corresponding physical address into the EPM. The first IK atomic pages of 
the packet memory correspond to the LPM. If software sets the 16 MSB of 

1 5 OverflowAddress to 0. . 1 023, results are undefined. When a packet is 

overflowed, the 16 MSB bits of OverflowAddress become the packetPage for 
that packet The SPU allows the next packet overflow when it writes into this 
configuration register. 



20 8. IntlfNoMoreXsizePages (4) 

(a) Default Value: OxF (i.e. the interrupt will never be generated) 

(b) Description: Specifies the index of a virtual page (0:256 bytes, 1:512 bytes, 
., 8:64K bytes, 9-15: no virtual page). Whenever the PMMU detects that 

there are no more virtual pages of that size in all the LPM, the 
25 NoMoreThanXSizePagesInt interrupt will be generated to the SPU. 



9. IntlflLessThanXpacketldEritries (9) 

(a) Default Value: 0 

(b) Description: Minimum number of entries in the QS available for new 
30 packet identifiers. If the actual number of available entries is less than this 
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number, an interrupt will be generated to the SPU. If this number is 0, the 
LessThanXPacketldEntriesInt interrupt will not be generated. 

10. DefaultPacketPriority (3) 

(a) Default Value: 0 

(b) Description: Provides the priority level for the 
PacketAvailableButNoContextlnt interrupt when 
PacketAvailableButNoContextMapping is 0. 

1 1. ContextSpecificPatternMatchingMask: (8x(32x2)) 

(a) Default Value: 

(1) SelectVector: select all bytes 

(2) RegisterVector: store 4 bytes in each register 
(EndOfMask is hardwired to 1) 

(b) Description: It specifies, for masked load/store operations, which bytes to 
load/store and in which (consecutive) registers. Software will guarantee that a 
stream only access its corresponding context-specific mask. 

Fig. 23 illustrates the ContextSpecificPAtternMAtching mask 
configuration register. 

12. FirstlnputQueue (5) 

(a) Default Value: 0 

(b) Description: Specifies the smallest number of the queue into which packets 
from the PMMU will be inserted. 

13. SoftwareOwned (4) 

(a) Default Value: 0 (not software owned) 

(b) Description: one bit per LPM block. If ' l\ the block is software owned, 
which implies that the memory of the block is managed by software, and that 
the VirtualPageEnable bits for that block are a don't care. 
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14. MaxActivePackets (32x9) 

(a) Default Value: 256 for each of the queues. 

(b) Description: Specifies, for each queue q y a value between 0 and 256 that 
5 corresponds to the maximum number of packets within queue q that can be 

being processed by the SPU. 

Fig. 24 illustrates the MaxActivePackets configuration register. 



15. CodeEntryPoint (32x30) 
10 (a) Default Value: 0 for each of the queues. 

(b) Description: The contents of the CodeEntryPoint register associated to 
queue q are sent to the SPU when a context is activated which has been pre- 
loaded with a packet that resides in queue q. 

15 16. CodeEntryPointSpecial (30) 

(a) Default Value: 0 

(b) Description: The contents of this register are sent to the SPU when a 
context is activated due to the fact that all the contexts become PMU-owned. 



20 17. Bypass Hooks (9) 

(a) Default Value: 0 

(b) Description: See Fig. 32. Each bit activates one hardware bypass hook. 
The bypass hook is applied for as many cycles as the corresponding bit in this 
register is asserted. 

25 

18. InternalStateWrite (12) 

(a) Default Value: 0 

(b) Description: See Fig. 33. Specifies one word of internal PMU state. The 
word of internal state will be available to software when reading the 

30 InternalStateRead configuration register. The InternalStateWrite configuration 

register is only used in one embodiment to debug the PMU. 
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Read-only Registers 

1. SizeOfOverflowedPacket(16) 

(a) Default Value: 0 

5 (b) Description: Whenever the PMU has to overflow a packet, this register will 

contain the size in bytes of that packet 

2. TimeCounter (64) 

(a) Default Value: 0 

10 (b) Description: Contains the number of core clock cycles since the last reset 

of the PMU. 

The TimeCounter configuration register is illustrated in Fig. 25. 

15 3. StatusRegister(8) 

(a) Default Value: 1 

(b) Description: Contains the state of the PMU- This register is polled by the 
SPU to figure out when the reset or freeze has completed (Freeze and Reset 
bits), or to figure out the source of packet error per inbound device identifier 

20 (Err: 1 - error,0 - no error; EPM: 1 - error has occurred while packet is 

overflowed to EPM, 0 - error has occurred while packet is being stored in 
LPM; PSM: 1 - error due to a packet size mismatch, 0 - error due to a bus 
error). 

25 Fig. 26 illustrates the StatusRegister configuration register 

Interrupts 

The PMU can interrupt the SPU when certain events happen. Software can 
30 disable all these interrupts using some of the configuration registers listed above. 
Moreover, each stream can individually mask these interrupts, which is the subject of 
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a separate patent application. The list of interrupts that the PMU generate are as 
follows: 

l.OverflowStartedlnt 
5 (a) Interrupt Condition : When the PMMU cannot store the incoming packet 

into the LocalPacketMemory, it will overflow the packet to the 
ExternalPacketMemory through the SIU. 
(b ) Disable Condition : OverflowEnable = *0* 

1 0 2. NoMorePagesOfXSizelnt 

(a) Interrupt Condition : When no more free virtual pages of the size indicated 
in IntlfNoMoreXSizePages are available. 

Ooi) Disable Condition : InflfNoMoreXSizePages = {10,1 1,12,13,14,15}. 

15 3. LessThanXPacketldEntriesInt 

(a > Interrupt Condition : When the actual number of available entries in the QS 
is less than IntlfLessThanXPacketldEntries. 

(b) Disable Condition : IntlfLessThanXPacketldEntries = 0 

20 4. PacketAvailableButNoContextPriorityPint (P=0..7) 

fa > Interrupt Condition : When a packet identifier is received by the RTU from 
the QS but there is no available context. 

(b ) Disable Condition : PacketAvailableButNoContextPriority/ > IntEnable= '0' 

25 5. AutomaticPacketDropInt 

(a) Interrupt Condition : When a packet cannot be stored in LPM and 
OverflowEnable = 4 0\ 

(b) Disable Condition : AutomaticPacketDropIntEnable = *0' 
30 6. PacketErrorlnt 
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(a) Interrupt Condition : When the actual size of the packet received from the 
ASIC does not match the value in the first two bytes of the ASIC-specific 
header, or when a bus error has occurred. 

(b) Disable Condition : PacketErrorlntEnable = '0' 

5 

Interrupts to the SPU in this embodiment are edge-triggered, which means that 
the condition that caused the interrupt is cleared in hardware when the interrupt is 
serviced. This also implies that the condition that causes the interrupt may happen 
several times before the interrupt is served by the SPU. Therefore, the corresponding 

10 interrupt service routine will be executed only once, even though the condition that 
causes the interrupt has happened more than once. 

This behavior is not desirable for some of the interrupts. For these cases, a 
special interlock mechanism is implemented in hardware that guarantees that the 
condition will not happen again until the interrupt has been serviced. 

15 An example of the special interlock mechanism is the case of the 

OverflowStartedlnt and PacketAvailableButNoContextPriorityPM interrupts. In the 
first case, when a packet is overflowed, no other packet are overflowed until the 
software writes a new address in the on-the-fly configuration register 
OverflowAddress. If a packet has been overflowed but the Overflow Address register 

20 still has not been written by the software, any subsequent packet that would have 
otherwise been overflowed because it does not fit in the LPM must be dropped. 

For the 8 PacketAvailableButNoContextPriorityPInt (P = 0..7) interrupts, the 
PMU architecture implicitly guarantees that no multiple conditions (per each P) will 
25 occur. This is guaranteed by design since: 

(a) the PacketAvailableButNoContextPriorityPInt interrupt is only generated 
when a packet identifier of RTU priority P arrives to the RTU, and 

(b) at most, only one packet identifier with RTU priority P resides in the RTU. 
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The other interrupts can suffer from the multiple condition effect. Therefore, 
software should not rely on counting the number of times a given type of interrupt 
happens to figure out exactly how many times that condition has occurred. 

5 Protection Issues 

The architecture of the PMU in the instant embodiment creates the following 
protection issues: 

10 1 . An stream could read/write data from a packet other than the one it is processing. 
An stream has access to all the packet memory, and there is no mechanism to prevent 
an stream from accessing data from a totally unrelated packet unless the packet 
memory is mapped as kernel space. 

2; Since the configuration registers are memory mapped, any stream could update a 
15 configuration register, no matter whether the SPU is in single-stream mode or not. In 
particular, any stream could freeze and reset the PMU. 

3. Whenever a packet is completed or moved with reactivation, nothing prevents 
software from continuing "processing" the packet. 

20 Command Unit (CU) 

Software can update some information that the PMU maintains for a given 
packet and obtain this information. This is accomplished by software through some 
of the new XStream packet instructions referred to above. Some of these instructions 

25 are load-like in the sense that a response is required from the PMU. Others are store- 
like instructions, and no response is required from the PMU. 

Fig. 27 is a diagram of Command Unit 213 of Fig. 2, in relation to other blocks 
of the XCaliber processor in this example, all of which bear the same element 
numbers in Fig. 27 as in Fig. 2. The SPU dispatches, at most, two packet instructions 

30 per cycle across all contexts (one instruction per cluster of the SPU). The type of the 
packet instruction corresponds to the PMU block to which the instruction affects 
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(PMMU, QS or RTU). When the SPU dispatches a packet instruction, a single 
command to the PMU is generated and inserted into one of three different queues in 
the CU block (one queue per PMU block to which the command goes). Commands to 
the PMU are issued to PMMU command queue 2703, those to the QS go to QS 

5 command queue 2705, and command to the RTU go to the RTU command queue 
2707. Each queue can hold up to 8 commands. The SPU only dispatches a command 
to the CU if there are enough free entries in the corresponding queue. 

The CU is responsible for dispatching the commands to the respective blocks, 
and gathering the responses (if any) in an 8-entry ResponseQueue 2709, which queues 

10 responses to be returned to the SPU. The CU can receive up to three responses in a 
given cycle (one from each of the three blocks). Since (a) only one outstanding packet 
instruction is allowed per stream, (b) the Response Queue has as many entries as 
streams, (c) only one command to the PMU is generated per packet instruction, and 
(d) only one response is generated per each load-like command, it is guaranteed that 

15 there will be enough space in the ResponseQueue to enqueue the responses generated 
by the PMU blocks. The ResponseQueue should be able to enqueue up to two 
commands at a time. 

CU 213 also receives requests from SIU 107 to update the configuration 
registers. These commands are also sent to the PMMU, RTU and QS blocks as 

20 commands. The PMMU, QS, and RTU keep a local copy of the configuration 
registers that apply to them. The CU keeps a copy as well of all the configuration 
registers, and this copy is used to satisfy the configuration register reads from the SRJ. 

For read-only configuration registers, a special interface is provided between the 
CU and the particular unit that owns the read-only configuration register. In 

25 XCaliber's PMU, there exists two read-only configuration registers: one in the 
PMMU block (SizeOfOverflowedPacket) and the other one in the CU block 
(StatusRegister). Whenever the PMMU writes into the SizeOfOverflowedPacket 
register, it notifies the CU and the CU updates its local copy. 

Commands in different queues are independent and can be executed out of order 

30 by the PMU. Within a queue, however, commands are executed in order, and one at a 
time. The PMU can initiate the execution of up to 3 commands per cycle. The 



WO 03/005645 



PCT/US02/20316 



-69- 

PMMU and QS blocks give more priority to other events (like the creation of a new 
packetPage when a new packet arrives -PMMU-, or the extraction of a packet 
identifier because it needs to be sent out -QS-) than to the commands from the SPU. 
This means that a command that requests some data to be sent back to the SPU may 
5 take several cycles to execute because either the PMMU or QS might be busy 
executing other operations. 

RTU 227 has two sources of commands: from the QS (to pre-load packet 
information into an available context) and from the SPU (software command). The 
RTU always gives more priority to SPU commands. However, the RTU finishes the 
10 on-going context pre-load operation before executing the pending SPU command 

Command/response formats 

A command received by the CMU has three fields in the current embodiment: 
15 1 . Context number, which is the context associated to the stream that generated the 
command. 

2. Command opcode, which is a number that specifies the type of command to be 
executed by the PMU. 

3. Command data, which is the different information needed by the PMU to execute 
20 the command specified in the command opcode field. 

The PMU, upon receiving a command, determines to which of the command 
queues the command needs to be inserted. A command inserted in any of the queues 
has a similar structure as the command received, but the bit width of the opcode and 
25 the data will vary depending on the queue. The table of Fig. 28 shows the format of 
the command inserted in each of the queues. Not included are the Read Configuration 
Register and Write Configuration Register commands that the CU sends to the 
PMMU, QS and RTU blocks. 

Each command that requires a response is tagged with a number that 
30 corresponds to the context associated to the stream that generated the command. The 
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response that is generated is also tagged with the same context number so that the 
SPU knows to which of the commands issued it belongs. 

As described above, there is only one ResponseQueue 2709 (Fig. 27) that 
buffers responses from the three PMU blocks. Note that there is no need to indicate 
5 from which block the response comes since, at most, one packet instruction that 
requires a response will be outstanding per stream. Therefore, the context number 
associated to a response is enough information to associate a response to a stream. 

Fig. 29 is a table showing the format for the responses that the different blocks 
generate back to the CU. Not included in the table are the configuration register 
10 values provided by each of the blocks to the CU when CU performs a configuration 
register read. 

The RTU notifies the SPU, through a dedicated interface that bypasses the CU 
(path 27 11 in Fig. 27), of the following events: 

15 1. A masked load/store operation has finished. The interface provides the context 
number. 

2. A GetContext has completed. The context number associated to the stream that 
dispatched the GetContext operation, and the context number selected by the RTU is 
provided by the interface. A success bit is asserted when the GetContext succeeded; 

20 otherwise it is de-asserted. 

3. A pre-load either starts or ends. The context number and the priority associated to 
the packet is provided to the SPU. 

Reset and freeze modes 

25 

The PMU can enter the reset mode in two cases: 

1 . SPU sets the Reset configuration flag. 

2. XCaliber is booted. 

The PMU can also enter the freeze mode in two cases: 
30 1 . SPU sets the Freeze configuration flag. 
2. PMU finishes the reset sequence. 
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The reset sequence of the PMU takes several cycles. During this sequence, the 
Reset bit in the StatusRegister configuration register is set. After the reset sequence, 
all the configuration registers are set to their default values, and the PMU enters the 
5 freeze mode (the Reset bit in the StatusRegister is reset and the Freeze bit is set). 
When this is done, the SPU resets the Freeze configuration flag and, from that time 
on, the PMU runs in the normal mode. 

When the SPU sets the Freeze configuration flag, the PMU terminates the 
current transaction or transactions before setting the Freeze bit in the StatusRegister. 
1 0 Once in the freeze mode, the PMU will not accept any data from the network input 
interface, send any data out through the network output interface, or pre-load any 
packet 

The PMU continues executing all the SPU commands while in freeze mode. 
The SPU needs to poll the StatusRegister configuration register to determine in 
15 which mode the PMU happened to be (reset or freeze) and to detect when the PMU 
changes modes. 

The CU block instructs the rest of the blocks to perform the reset and the freeze. 
The following is the protocol between the CU and any other block when the CU 
receives a write into the reset and/or freeze configuration bit: 
20 1 . The CU notifies to some of the blocks that either a freeze or a reset needs to be 
performed. 

2. Every block performs the freeze or the reset. After completion, the block signals 
back to the CU that it has completed the freeze or reset. 

3. The CU updates the StatusRegister bits as soon as the reset or freeze has been 
25 completed. Software polls the StatusRegister to determine when the PMU has 

completely frozen. 

The different blocks in the PMU end the freeze when: 
1. IB, LPM, CU and QS do not need to freeze. 
30 2. As soon as the PMMU finishes uploading inbound packets, if any, and 
downloading outbound packets, if any. 
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3. As soon as the RTU has finished the current pre-load operation, if any. 

4. As soon as the OB is empty. 

While in freeze mode, the blocks will not: 

5 

1. start uploading a new packet; start downloading a completed packet; or generate 
interrupts to the SPU (PMMU) 

2. pre-load a context or generate interrupts to the SPU (RTU). 

10 If software writes a * V in the Freeze/Reset configuration register and then 

writes a '0* before the PMU froze or reset, results are undefined. Once the PMU 
starts the freeze/reset sequence, it completes it. 

Performance Counters Interface 

15 

The PMU probes some events in the different units. These probes are sent to 
the SIU and used by software as performance probes. The SIU has a set of counters 
used to count some of the events that the PMU sends to the SIU. Software decides 
which events throughout the XCaliber chip it wants to monitor. Refer to the SIU 
20 Architecture Spec document for more information on how software can configure the 
performance counters. 

Fig. 30 shows a performance counter interface between the PMU and the SIU. 
Up to 64 events can be probed within the PMU. All 64 events are sent every cycle to 
the SIU (EventVector) through a 64-bit bus. 

25 

Each of the 64 events may have associated a value (0 to 64K-1), Software 
selects two of the events (EventA and EventE). For each of these two, the PMU 
provides the associated 16-bit value (EventDataA and EventDataB, respectively) at 
the same time the event is provided in the EventVector bus. 
30 Events are level-triggered. Therefore, if the PMU asserts the event for two 

consecutive cycles, the event will be counted twice. The corresponding signal in the 
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EventVector will be asserted only if the event occurs, and for as many cycles as the 
event condition holds. 

The SIU selects which events are actually counted (based on how software has 
programmed the SIU). If the SIU decides to count an event number different from 
5 EventA or EventB, a counter within the SIU counts the event for as many cycles the 
corresponding bit in the EventVector is asserted If the events monitored are EventA 
and/or EventB 9 the SIU, in addition to counting the event/s, increments another 
counter by EventDataA and/or EventDataB every time the event occurs. 

Fig. 3 1 shows a possible implementation of the internal interfaces among the 
10 different blocks in PMU 103. CU acts as the interface between the PMU and SIU for 
the performance counters. CU 213 distributes the information in EventA and EventB 
to the different units and gathers the individual EventVector, EventDataA and 
EventDataB of each of the units. 

The CU block collects all the events from the different blocks and send them to 
15 the SIU. The CU interfaces to the different blocks to notify which of the events 
within each block need to provide the EventDataA and/or EventDataB values. 

Performance events are not time critical, i.e. they do not need to be reported to 
the SIU in the same cycle they occur. 

20 Figs. 34 through 39 comprise a table that lists all events related to performance 

counters. These events are grouped by block in the PMU. The event number is 
shown in the second column. This number corresponds to the bit in the EventVector 
that is asserted when the event occurs. The third column is the event name. The 
fourth column shows the data value associated to the event and its bit width in 

25 parentheses. The last column provides a description of the event. 

The CU block collects all of the events from the different blocks and sends them 
to the SIU. The CU interfaces to the different blocks to notify which of the events 
within each block need to provide the EventDataA and the EventDataB values. 

Performance events are not time critical, i.e. they do not need to be reported to 

30 the SIU in the same cycle that they occur. 
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Debug Bypasses and Trigger Events 

Hardware debug hooks are implemented in the PMU to help debugging of the 
silicon. The debug hooks are divided into two categories: 
5 1. Bypass hooks : will bypass potentially faulty functions. Instead of the faulty results 
generated by these functions (or, in some cases, no result at all), the bypass hook will 
provide at least some functionality that will allow other neighboring blocks to be 
tested. 

2. Trigger events : when a particular condition occurs in the PMU (trigger event), the 
10 PMU will enter automatically in single-step mode until, through the OCI Interface 
(Section), the SIU sends a command to the PMU to exit the single-step mode. 

Moreover, the PMU has the capability of being single-stepped. A signal 
(SingleStep) will come from the OCI Interface. On a cycle-by-cycle basis, the 
different blocks of the PMU will monitor this signal. When this signal is de-asserted, 
15 the PMU will function normally. When SingleStep is asserted, the PMU will not 
perform any work: any operation on progress will be held until the signal is de- 
asserted. In other words, the PMU will not do anything when the signal is asserted. 
The only exception to this is when a block can lose data (an example could be in the 
interface between two block: a block A sends data to a block B and assumes that 
20 block B will get the data in the next cycle; if SingleStep is asserted in this cycle, block 
B has to guarantee that the data from A is not lost). 

Bypass hooks 

25 

The different bypass hooks in the PMU are activated through the on-the-fly 
BypassHooks configuration register. Fig. 40 is a table illustrating the different bypass 
hooks implemented in the PMU. The number of each hook corresponds to the bit 
number in the BypassHooks register. The bypass hook is applied for as many cycles 
30 as the corresponding bit in this register is asserted. 
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Trigger Events 

The following is a list of trigger events implemented in the PMU. 

5 1 . A new packet of size s bytes is at the head of the IBU. 
(a) s = 0: any packet, 

2. A packetld from source s with packetPage pp is inserted in queue q in the QS. 

(a) s =0: PMM, s =1: QS, s =2: CMU; s =3: any 

(b) pp = 0x10000: any 
10 (c) q = 33: any 

3. A packetld from queue q with packetPage pp and packetNumbet pn is sent to RTU. 

(a) />/> = 0x10000: any 

(b) ? = 33:any 

(c) pn = 256: any 

15 4. A packetld with packetPage pp and packetNumber pn reaches the head of queue q 
in theQS. 

(a) p/? = 0x10000: any 

(b) q = 33: any 

(c) pn = 256: any 

20 5. A packet with RTU priority p and packetPage pp and packetNumber pn is pre- 
loaded in context c. 

(a) /?/> = 0x10000: any 

(b) q = 33: any 

(c) pn = 256: any 
25 (d)c = 8:any 

6. A packetld from queue q with packetPage pp and packetNumber pn is sent for 
downloading to PMM. 

(a) /?p = 0x10000: any 

(b) q = 33: any 
30 (c) pn = 256: any 
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7. A packetld with packetPage pp and packetNumber pn reaches the head of queue q 
in the QS. 

(a) /?/? = 0x10000: any 

(b) ? = 33: any 

5 (c) pn = 256: any 

8. Packet command pc is executed by block b. 

(a) pc = 0: GetSpace; pc = 1 : FreeSpace; pc = 2: InsertPacket; pc = 3: 
ProbePacket; pc = 4: ExtractPacket; pc - 5: CompletePacket; pc = 6: 
UpdatePacket; pc = 7: MovePacket; pc = 8: ProbeQueue; pc = 9: GetContext; 
10 pc - 10: ReleaseContext; pc = 1 1 : MaskedLoad; pc = 12: MaskedStore; pc = 

13: any 

(b) Z> = 0: RTU; 6=1: PMM; 6 = 2: QS; Z> = 3 : any 
Detailed Interfaces with the SPU and SIU 

15 

The architecture explained in the previous sections is implemented in the 
hardware blocks shown in Fig. 41: 

SPU-PMU Interface 

20 

Figs. 42 - 45 describe the SPU-PMU Interface. 

SIU-PMU Interface 

25 Figs. 46-49 describe the SIU-PMU Interface. 

The specification above describes in enabling detail a Packet Memory Unit 
(PMU) for a Multi-Streaming processor adapted for packet handling and processing. 
Details of architecture, hardware, software, and operation are provided in exemplary 
30 embodiments. It will be apparent to the skilled artisan that the embodiments 

described may vary considerably in detail without departing from the spirit and scope 
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of the invention. It is well-known, for example, that IC hardware, firmware and 
software may be accomplished in a variety of ways while still adhering to the novel 
architecture and functionality taught 

5 

Non-Speculative Pre-Fetch Operation 

In another aspect of the present invention, the inventor provides a method and 
apparatus that enables a non-speculative pre-fetch of processing instructions 

10 performed by the SPU upon early notification from the PMU that a context has been 
selected for processing and that preloading of the context will begin. Such a method 
and apparatus is described in enabling detail below. 

Fig. 50 is a block diagram illustrating various elements and interaction 
between elements in performance of a non-speculative pre-fetch operation according 

1 5 to one embodiment of the present invention. 

Referring to S/N 09/737,375 listed as a priority document in the cross- 
reference section above, there is disclosed a general method for selecting a context, 
pre-loading the context with packet information, and then releasing the context to the 
SPU for processing. The headings under which the disclosure is made are Register 

20 Transfer Unit (RTU). Context States, and Pre-loading a Context 

Because a context being pre-loaded for packet processing is always a PMU- 
owned context, the RTU has all the available write ports to that context to perform the 
loading of packet information. It is disclosed above under the heading Pre-loading a 
Context that whenever the pre-loading operation starts, the RTU notifies this event to 

25 the SPU through a dedicated interface. Similarly, when the pre-loading operation is 
completed, the RTU also notifies the SPU of this fact. Thus the SPU expects two 
basic notifications (start and end) for each packet pre-load operation. A special 
notification is provided to the SPU when the RTU starts and ends a pre-load in a same 
cycle. 

30 In the instant example referring to Fig. 50, a packet management unit (PMU) 

5102 is provided having a register transfer unit (RTU) 5103 illustrated therein, the 
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RTU having a software-configurable hardware table (T) 5 104 available thereto. PMU 
5102, more specifically through RTU 5103, has a dedicated communication link 5106 
established between itself and streaming processor unit (SPU) 5107. SPU 5107 is 
adapted to process the packets using instructions that are pre-fetched in embodiments 
5 of the present invention. 

SPU 5107, in a preferred embodiment, is connected to an instruction cache 
memory 5109, which is adapted to store, among other data, first instructions of 
threads for processing data, and in some cases sequential instructions for specific 
threads. Connection from SPU 5107 to cache 5109 is logically represented herein by a 

10 link 5 108, Storing the first instruction of a thread in an on-chip instruction cache is 
not required for the invention, as the first instruction can be anywhere in memory, 
even on a disk, but it is a convenience and preferred to have the instructions stored as 
close as possible to the processing core. In an embodiment of the present invention 
packets-arriving for processing are staged in queues according to packet types, and a 

1 5 specific thread is associated with each packet type for processing. In this embodiment 
of the invention a table 5104 associates queues (packet types) to specific threads 
needed for processing by a program counter (PC) pointer, indicated in Fig. 50 as PC# 
and element 5105. PC# 5 105 is not to be confused with a packet command (pc) 
disclosed with reference to S/N 09/737,375 under the heading Trigger Events . 

20 A cluster 5 101 of contexts and functional resources generic to the processing 

core of SPU 5107 is illustrated in this example. Functional resources are circuitry 
required to perform calculations such as multiplication, division, addition and 
subtraction. There may also be special functions such as trigonometric, averaging, 
and weighting functions performed by functional units, and memory access functions 

25 as well. Contexts are well known in the art, and are register files into which, in this 
case, packet information is loaded prior to processing. The illustration of contexts and 
resources is exemplary only in this example, as there may be different numbers of 
each, and there is generally not a one-to-one correspondence between resources and 
functional units. 

30 It is the responsibility of PMU 5102 through RTU 5103 via link 5106 to select 

available (not SPU-owned) contexts in cluster 5 101 for preloading packet information 
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thereto for processing by SPU-5107 and to activate those selected and loaded 
contexts, at which time SPU 5107 will own the activated contexts until processing is 
complete. It is noted herein that any context in cluster 5101 may issue instructions 
only to the functional resources within that cluster. When SPU 5107 finishes 
5 processing a thread it releases the context back to PMU 5 1 02. 

Table 5 104 contains a PC # 5 105 for each of the different queues into which 
packets can be classified by the PMU. PC# 5 105 represents, in a preferred 
embodiment, the cache memory address of the beginning of its corresponding thread. 
In other embodiments the PC may point to an address for a first instruction for a 

10 thread in any memory device available to the processing core. It is noted herein that 
in a preferred embodiment there are 32 queues available for storing identifiers of data 
packets; The number of 32 is not meant to be a limitation, as there could be more or 
less than 32 queues provided and made available in various configurations. In 
practice of the invention a packet arrives for processing and is enqueued into one of 

15 the 32 available queues according to a classification scheme which may include 
priority. The scheme in a preferred embodiment revolves around packet type. For 
example, a voice-over-Internet protocol (VoIP) packet may be assigned a higher 
priority than an e-mail packet. Therefore, the VoIP packet will be en-queued in one of 
the 32 queues of higher number, perhaps queue 32 if VoIP packets are assigned the 

20 highest priority in a particular scheme, which may be varied according to enterprise 
design. In fact, there are more than one type of VoIP packets that may be encountered 
and they may differ somewhat from each other in exact instruction types required to 
process them. Therefore, there may be more than one queue dedicated for VoIP 
packets of differing types. It may be that queue numbers 29-32 are dedicated to the 

25 range of VoIP packets encountered. Other types of data packets encountered are 
similarly queued according to type and priority level of processing. 

Each queue has associated with it a corresponding PC# 5105. When RTU 5 1 03 
selects an available context from within cluster 5101 for processing a newly arrived 
data packet, it sends a notification of the fact to SPU 5107 over dedicated link 5106. 

30 This notification contains the correct PC # (associated to the queue) for that queue. 
The PC# identifies the beginning memory location or address of the appropriate 
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thread for processing stored in instruction cache 5109 in a preferred embodiment, or 
the address for a first instruction for a thread in any other memory device in 
alternative embodiments. The SPU will be able to fetch and execute from that point 
on all of the instructions of which the thread is composed. A thread ends with a 
5 special instruction (called release) that effectively send the ownership of the context 
the stream is running, back to the PMU by notification via link 5 106. 

Immediately after the first notification that a context has been selected for 
processing, RTU 5103 begins loading packet information into the selected context for 
processing. Simultaneously, in this embodiment, SPU 5107 fetches the appropriate 

1 0 instruction thread from cache 5 1 09 over link 5 1 08 using PC# 5 1 05 as a pointer. After 
loading the selected context with the appropriate data for processing, RTU 5103 sends 
a notification of activation of the context to SPU 5 107 over link 5 106. SPU 5107, 
assuming that it has completed the pre-fetch, may then commence processing. In 
some cases, particularly those cases in which there is no instruction cache, and the 

15 thread must be fetched from a more distant memory, the pre-fetch may take longer 
than the loading of the context. In one embodiment, a special packet identification 
thread is provided to handle a possible situation wherein a packet sender does not 
include information designating the type of data packet and/or the appropriate queue 
destination. In this case, the un-identified packet is en-queued into a general queue set 

20 aside for this purpose. This general queue has a PC# associated therewith and 

included in table (T) 5 104. Thus when a context is selected for processing the packet 
by RTU 5103, the notification to SPU contains the PC# pointing to the special packet- 
type identification instruction (the start of the thread) stored in cache 5109, in a 
preferred embodiment. The SPU pre-fetches the special thread as described in the 

25 normal sequence above. During processing, the special thread will determine the 
exact packet type and the appropriate queue that it should be placed in. At this time 
the packet is re-queued in the appropriate queue, after which a new context is 
subsequently selected and re-notification to SPU 5107 is initiated, or the special 
thread might decide to process the packet itself. 

30 The special circumstance described above needs only be performed on a first 

data packet of a data packet flow from a same source. The determined classification 
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information (appropriate queue for packets of this flow) can be tabled by SPU 5107 
within T 5104 and sent back to RTU 5103 so that a next packet of the same flow can 
be properly classified and information about the packet can be en-queued in the 
appropriate queue. If for example, the unclassified packet was determined to be a 
5 type not accounted for in terms of existing instruction threads, then a determination 
may be made to create a new thread, assign a PC# and queue to handle the new packet 
type. In still another embodiment, a special hardware mechanism is provided at the 
port for intercepting un-classified data packets. The hardware has its own queue and 
associated PC# and is enhanced with a processing capability and functional resources 
10 to at least identify the packet independently from the SPU. After the packet is 

classified by the hardware, it is looped back to ingress for proper queuing according to 
priority. 

Referring to the first and preferred embodiment described above, it may be that 
SPU 5107, while processing an unclassified packet for identification, will find that the 
15 determined priority of the packet is not high and that there are numerous packets 
waiting for processing that are classified and of a higher priority. In this case, an 
interrupt is generated to cease processing the packet and release the context back to 
the PMU without re-queuing the packet. The packet can remain in the general queue 
until the higher priority packets are processed. This, of course assumes that the SPU 
20 has knowledge of multiple-queued packets before processing, information which can 
be propagated over link 5106 from RTU 5102 within T 5104. 

Because all packets are queued by type, and each queue is associated with a 
unique PC# pointing to an address for the beginning of an appropriate thread stored in 
cache 5109, or in another memory device, SPU 5108 is enabled to perform a non- 
25 speculative pre-fetch, thus assured that the instructions retrieved are the actual 
instructions required for processing. 

Fig. 51 is a process flow chart illustrating steps for implementing a non- 
speculative pre-fetch operation according to an embodiment of the present invention. 
At step 5201 a data packet arrives for processing. As previously described above 
30 there are 32 available queues in a preferred embodiment wherein information 

pertinent to the data packet may be placed according to class and priority. Each queue 
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has an associated program counter (PC#) that points to an address in memory for the 
beginning of a specific thread required to process the data packet 

Time is indicated in Fig. 5 1 on a vertical axis, activities of the RTU are 
indicated on the left of the figure, and activities of the SPU are indicated on the right 
5 of the figure. At step 5202, the RTU selects an available (not SPU-owned) context 
and notifies the SPU that the particular context will be activated for processing. In the 
notification at step 5202, the PC# is provided from the association with the queue for 
the packet, indicating the address for the first instruction for the thread to process the 
packet. 

10 Upon receipt of the notification from the RTU at step 5202, the SPU may begin 

pre-fetching the appropriate thread. At substantially the same time the RTU, at step 
5203, begins loading packet information into the selected context At step 5205, 
loading is complete, and the RTU notifies the SPU and releases (activates) the 
context. 

1 5 There are two necessary conditions for the SPU to process the data in the 

context One is that the RTU releases the context, and notifies the SPU. The other is 
that the SPU has loaded the first instruction of an appropriate thread for processing. 
Either condition may finish first, so, in one case the SPU will wait for the RTU, and 
begin processing as soon as the release notification arrives from the RTU; while in the 

20 other case the SPU will receive the notification from the RTU, but will finish loading 
the appropriate thread before beginning to process at step 5208. 

The optional situation is indicated in Fig. 51 by alternate paths for the SPU. IN 
one case the SPU finishes pre-fetch at step 5206 before the RTU finishes loading, and 
the SPU must therefore wait for the loading to finish, and for the notification from the 

25 RTU before processing may commence. In the other option, shown as step 5207, the 
notification from the RTU arrives before the SPU finishes pre-fetch, so the SPU 
continues, and processing may commence at step 5207 when the pre-fetch is finished. 

The present invention is particularly applicable to the processing of data packets 
by data packet routers connected to a data packet network. However, this should not 

30 be construed as a limitation of the present invention. Other types of data processing 
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machines such as Internet data servers, e-mail servers, and so on may benefit from the 
present invention. 

Accordingly the claims that follow should be accorded the broadest interpretation. 
The spirit and scope of the present invention is limited only by the claims that follow. 
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What is claimed is: 

LIna data-packet processor, a system for non-speculative pre-fetching, comprising: 

5 a processing unit having a first portion for processing the data packets, using 

instruction threads specific to packet type, and a second portion comprising a pool of 
context registers and functional units for processing; 

a packet-management unit (PMU) for managing data packets of different types 
received for processing, including selecting and loading the context registers; 
10 a memory storing at least an initial instruction of instruction threads; and 

a table equating packet types with pointers to memory locations for the at least 
first instructions of instruction threads specific to the packet types; 

characterized in that the PMU selects a context from the pool of contexts for 
processing of a data packet, the table is consulted for the pointer, and the pointer is 
1 5 provided to the processing unit first portion, enabling the processing unit first portion 
to prefetch at least an initial instruction for the packet to be processed at least 
partially in parallel with loading of the context 

2. The system of claim 1 wherein the second portion of the processing unit comprises 
20 separate clusters, each cluster comprising contexts and functional units. 

3. The system of claim 1 wherein the table is in the PMU. 

4. The system of claim 1 wherein the processor is a dynamic multi-streaming 
25 processor. 

5. The system of claim 1 wherein the memory holding at least a first instruction of 
the instruction threads is an on-chip instruction cache memory. 

30 6. The system of claim 1 wherein the memory holding at least a first instruction of 
the instruction threads is an off-chip memory. 
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7. The system of claim 1 wherein data packets to be processed are stored in queues 
according to instruction threads required to process the packets, and wherein the 
queue from which a packet arrives for processing indicates the packet type. 

5 

8. In a data-packet processor having a first portion for processing data packets, using 
instruction threads specific to packet type, and a second portion comprising a pool of 
context registers and functional units for processing, a method for accomplishing pre- 
fetch of at least a first instruction for processing, comprising steps of: 

10 (a) selecting, by a packet-management unit (PMU), an available context for 

loading information for processing a packet ready for processing; 

(b) consulting a table relating packet type for the packet ready to be processed 
to a pointer to a memory location for at least a first instruction of an instruction thread 
to process the packet; 
15 (c) providing the pointer to the first portion; and 

(d) pre-fetching the at least first instruction of the thread to process the data 
packet, at least partially in parallel with loading the context. 

9. The method of claim 8 wherein the second portion of the processing unit comprises 
20 separate clusters, each cluster comprising contexts and functional units. 

10. The method of claim 8 wherein the table is in the PMU. 

1 1 . The method of claim 8 wherein the processor is a dynamic multi-streaming 
25 processor. 

12. The method of claim 8 wherein the memory holding at least a first instruction of 
the instruction threads is an on-chip instruction cache memory. 

30 13. The method of claim 8 wherein the memory holding at least a first instruction of 
the instruction threads is an off-chip memory. 



WO 03/005645 



PCT/US02/20316 



-86- 



14. The method of claim 8 wherein data packets to be processed are stored in queues 
according to instruction threads required to process the packets, and wherein the 
queue from which a packet arrives for processing indicates the packet type. 
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Word* 
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Reserved 
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Reserved 
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ContextSpecificPatternMatchingMask3 




502-515 


Reserved 
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Reserved 
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Reserved 
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Reserved 
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CodeEntryPointB 
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CodeEntrvPoint 1 4 
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Reserved 
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Block 
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vrperana rieias 
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PMMU 


0: GetSpace 
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0: InsertPacket 
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Block 


Event* 


Event Name 


Event Data 


Event Description 


IB 


0 


Insert 


FvdeBt^bEntries (3) 


A 16-byte chunk of packet 
data is inserted at the tail of 
the IB. The event data is the 
number of free entries in this 
buffer before the insertion* 


OB 


1 


InsertO 


Fre&uff&ErfoiesO (3) 


A 16-byte chunk of packet 
data is inserted at the tail of 
the OB (device identifier 0). 
The event data is the number 
of free entries in this buffer 
before the insertion* 


2 


Insertl 


FreeBt^erEntmsl (3) 


A 16-byte chunk of packet 
data is inserted at the tail of 
the OB (device identifier 0). 
The event data is the number 
of free entries in this buffer 
before the insertion. 




3 


PacketAllocSuccessO 


PacketSize(16) 


The PMMU successfully 
allocates a consecutive space 
in block 0 of the 1PM for a 
packet of PacketSize bytes 
coming from the network 
input interface. 


PMMU 


4 


PacketAllocSuccessl 


PacketSize (16) 


The PMMU successfully 
allocates a consecutive space 
in block 1 of the LPM for a 
packet of PacketSize bytes 
coming from the network 
input interface. 


5 


PacketAllocSuccess2 


PacketSize(16) 


The PMMU successfully 
allocates a consecutive space 
in block2 of the LPMfor a 
packet of PacketSize bytes 
coming from the network 
input interface. 




6 


PacketAllocSuccessS 


PacketSize(16) 


The PMMU successfully 
allocates a consecutive space 
in block 3 of the IPM for a 
packet of PacketSize bytes 
coming from the network 
input interface. 
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7 


PacketAllocFail 


LPMJkeWonk(16) 


The PMMU failed in allocating 
space in the LPM for a packet 

wi I m IIUIII LUC IJUct VVOllV JIipUv 

interface. Hie event data is die 
total number of words (4 bytes) 
free in the LPM 


p 


8 


PacketAllocFail 


PacketSize(16) 


The PMMU failed in allocating 
space in uc urivi ior a paCKei oi 
PacketSkebytes coning from the 
network input interface. 


M 
M 
U 


o 


Parkd A HnrFnilDmn 




ine JrMJViu iaueo in allocating 
space in the IPM for a packet of 
Prf^Saze bytes coming from the 
ucl wjnv input iTnrrracei ine 
packet is dtoppecL 




10 


PacketAllocFailOverflo 
w 


P<xkdSize(16) 


The PMMU failed in allocating 

CTVifY* in tYw* T "PAA |>nr 4 T\of*1n»f f\4 

Pa&etSizebytes coming from the 
network input interface; the 
cachet k overflnropfl 




11 


Moc256FaU0 


B!ak0Fre£)tB(16) 


The allocation of a packet of 2- 
255 bytes failed in block 0 of 
LPM. 




12 


Alloc256FaUl 


BlaklFweB)te(16) 


Hie allocation of a packet of 2- 
255 bytes failed in block 1 of 
LPM 




13 


Alloc256Fail2 


Bl<xk2FweB)tes(16) 


Hie allocation of a packet of 2- 
255 bytes failed in block 2 of 
LPM 




14 


AUoc256FailS 


Bak3FreeByta(16) 


The allocation of a packet of 2- 
255 bytes failed in block 3 of 
LPM. 




15 


Alloc512FailO 


BlakOFweB)ts(16) 


Hie allocation of a packet of 
256-511 bytes failed in block 0 
of LPM 




16 


AUoc512Faill 


BlaklFw&yte(16) 


Hie allocation of a packet of 
256-511 bytes failed in block 1 
of LPM 




17 


Alloc512Fail2 


Bhk2Fw£yte>(16) 


Hie allocation of a packet of 
256-511 bytes failed in block2 
of LPM 



Fig. 35 
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18 


Alloc512Fail3 


Block3FreeBytes (16) 


The allocation of a packet 
01256-511 bytes failed in 
block 3 of LPM 




19 


AlloclKFailO 


BlockOFreeBytes (16) 


The allocation of a packet 
of 512-1023 bytes felled in 
block 0 of LPM 




20 


AlloclKFaill 


BlocklFreeBytes (16) 


The allocation of a packet 
of 512-1023 bytes felled in 
block l of LPM 




21 


AlloclKFaitt 


Block2FreeBytes (16) 


The allocation of a packet 
of 512-1023 bytes foiled in 
block 2 of LPM. 




22 


Alloc] KFaiU 


Block3FreeBytes (16) 


The allocation of a packet 
of 512-1023 bytes foiled in 
block 3 of LPM. 




23 


AlloclKFailO 


BlockOFreeBytes (16) 


The allocation of a packet 
of 1024-2047 bytes foiled 
in block Oof LPM 




24 


AlloclKFaill 


BlocklFreeBytes (16) 


The allocation of a packet 
of 1024-2047 bytes foiled 
in block Oof LPM 


p 

M 


25 


AlloclKFail2 


BlocklFreeBytes (16) 


The allocation of a packet 
of 1024-2047 bytes foiled 
in block Oof LPM 


M 
U 


26 


AlloclKFail3 


Block3FreeBytes (16) 


The allocation of a packet 
of 1024-2047 bytes felled 
in block 0 of LPM 




27 


Alloc4KFaiia 


BlockOFreeBytes (16) 


The allocation of a packet 
of 2048-4095 bytes felled 
in block 0 of LPM. 




28 


Alloc4KFaill 


BlocklFreeBytes (16) 


The allocation of a packet 
of 2048-4095 bytes felled 
in block 1 of LPM 




29 


Alloc4KFail2 


BlocklFreeBytes (16) 


The allocation of a packet 
oi zwo-wio oytes tailed 
in block 2 of LPM 




30 


Alloc4KFail3 


Block3FreeBytes (16) 


The allocation of a packet 
of 2048-4095 bvtes failed 
in block 3 of LPM. 




31 


Allocl6KFailO 


BlockOFreeBytes (16) 


The allocation of a packet 
of 4096-16383 bytes foiled 
in block Oof LPM 




32 


Allocl6KFaill 


BlocklFreeBytes (16) 


The allocation of a packet 
of 4096-16383 bytes foiled 
in block 1 of LPM 
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33 


AllocloKFaiu 


Block2FreeBytes (16) 


The allocation of a packet of 
4096-16383 bytes failed in 
block 2 of LPM. 




34 


Alloc 16KFau3 


Block3FreeBytes (16) 


The allocation of a packet of 
4096-16383 bytes failed in 
block3ofLPM. 




35 


Alloc64KFailO 


BlockOFreeBytes (16) 


The allocation of a packet of 
16384-65535 bytes failed in 
block 0 of LPM. 




36 


Alloc64KFaill 


BlocklFreeBytes (16) 


The allocation of a packet of 
16384-65535 bytes failed in 
block 1 of LPM. 




37 


Alloc64KFail2 


Block2FreeBytes (16) 


The allocation of a packet of 
16384-65535 bytes failed in 
block 2 of LPM. 


r 
M 


38 


Alloc64KFail3 


Block3FreeBytes (16) 


The allocation of a packet of 
16384-65535 bytes failed in 
block 3 of LPM. 


M 
U 


39 


GetSpaceSuccess 
0 


RequestedSize (16) 


The PMMU successfully 
satisfied in block 0 of LPM a 
GetSpace() of RequestedSize 
bytes. 




40 


GetSpaceSuccess 
1 


RequestedSize (16) 


The PMMU successfully 
satisfied in block 1 of LPM a 
GetSpaceO of RequestedSize 
bytes. 




41 


GetSpaceSuccess 
2 


RequestedSize (16) 


The PMMU successfully 
satisfied in block 2 of LPM a 
GetSpaceO of RequestedSize 
bytes. 




42 


GetSpaceSuccess 
3 


RequestedSize (16) 


The PMMU successfully 
satisfied in block 3 of LPM a 
GetSpaceO of RequestedSize 
bytes. 




43 


GetSpaceFati 


RequestedSize (16) 


The PMMU could not satisfy a 
GetSpaceO of RequestedSize 
bytes. 




44 


GetSpaceFail 


TotalFreeWords (16) 


The PMMU could not satisfy a 
GetSpaceO* The data event is 
the total number of words (4 
bytes) free in the LPM. 






racKetueaiiocati 
onO 


iSlocKUrreetiytes (16) 


The PMMU de-allocates space 
in block 0 of the LPM due to a 
downloading of a packet. The 
event data is the number of 
bytes free in the block before 
the de-allocation occurs. 
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p 

M 
M 
U 


46 


PacketDea 
llocationl 


BlocklFreeBytes (16) 


The PMMU de-allocates space in 
block 1 of the LPM due to a 
downloading of a packet. The event 
data is the number of bytes free in 
the block before the de-allocation 
occurs. 


47 


PacketDea 
llocationl 


Block2FreeBytes (16) 


The PMMU de-allocates space in 
block 2 of the LPM due to a 
downloading of a packet. The event 
data is the number of bytes free in 
the block before the de-allocation 
occurs. 


48 


PacketDea 
Uocation3 


Block3FreeBytes (16) 


The PMMU de-allocates space in 
block 3 of the LPM due to a 
downloading of a packet The event 
data is the number of bytes free in 
the block before the de-allocation 
occurs. 


Q 
s 


49 


InsertFro 
mPMMU 


FreeEntriesInQS (8) 


A packet identifier is inserted from 
the PMMU into one of the queues. 
The event data is the number of free 
entries in the pool of entries before 
the insertion. 


50 


InsertFro 
mCU 


FreeEntriesInQS (8) 


A packet identifier is inserted from 
the CU into one of the queues. The 
event data is the number of free 
entries in the pool of entries before 
the insertion. 


51 


InsertFro 
mQS 


FreeEntriesInQS (8) 


A packet identifier is inserted from 
the QS into one of the queues. The 
event data is the number of free 
entries in the pool of entries before 
the insertion. 


CO 


52 


InsertPM 
MU 


FreePMMUcmdEntries 
(4) 


A command is inserted in the 
PMMU command queue. The event 
data is the number of free entries in 
this queue before the insertion. 


53 


InsertQS 


FreeQScmdEntries (4) 


A command is inserted in the QS 
command queue. The event data is 
the number of free entries in this 
queue before the insertion. 



Fig. 38 
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cu 


54 


insertRTU 


FreeRTUcomdEntries 
(4) 


A command is inserted in the 
RTU command queue. The 
event data is the number of 
free entries in this queue 
before the insertion. 




55 


Responselnsert 


Num. OfResponses (I) 


One or two responses are 
inserted in the response 
queue. The event data 
NumOJResponses codes how 
many(0:one, l:two). 


RTU 


56 


Activate 


NumPMUownedCtx 
(3) 


A context becomes SPU- 
owned. The event data is the 
current number of PMU- 
owned contexts before the 
activation. 


57 


PreloadStarts 


SlUlatency (8) 


A pre-load of a context starts. 
The event data is the number 
of cycles (up to 255) that the 
RTU waited for the first 
header data to preload is 
provided by the SIU. 


58 


PreloadAccepted 


NumOfPreloads Waitin 
g(3) 


A packet identifier is accepted 
from the QS. The event data 
is the number of valid entries 
in the new packet table before 
the acceptance. 


59 


CommandWaits 


CommandWaitCycles 
(8) 


A command from the CU is 
ready. The event data is the 
number of cycles (up to 255) 
that it waits until it is served. 


LPM 


60 


ReadSJU 


SlUwaitCycles (3) 

t 


The SIU performs a read into 
the LPM. Hie event data is 
the number of cycles (up to 7) 
that it waits until it can be 
served. 


61 


WriteSIU 


SlUwaitCycles (3) 


The SIU performs a write into 
the LPM. The event data is 
the number of cycles (up to 7) 
that it waits until it can be 
served. 



Table 1: Events probed for performance counters 
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Block 


It 


Name 


Description 


IBU 


f\ 
V 


HeadAlways Valid 


The IBU always provides a valid packet The packet 
provided is a 16-byte packet, from devide Id 0, with 
the 3 rd byte 0, and byte i 0=4.. 15) to value /. 


OBU 


4 


HeadAlways Valid 


The OBU always provides a valid packet The packet 
provided is a 16-byte packet, from devide Id 0, with 
the 3 rd byte 0, and byte i (i=4..15) to value /. 


5 


AlwaysToDevIdO 


The OBU hardwires the outbound device identifier to 
0. 


6 


AlwaysToDevIdl 


The OBU hardwires the outbound device identifier to 
1. 


PMM 


8 


SimpleAllocation 


The PMM performs the following allocation 
mechanism when receives a new packet: 

o 64K bytes (1 fall block) are always allocated 

(i.e. the size of the packet is not taken into 

account). 

o One bit per block indicates whether the block 

is busy (i.e. it was selected to store a packet). 

The download of that packet resets the bit. 
o If more that non-busy block exists, the block 

with the smallest index is chosen, 
o If no available blocks exist, the packet will be 

dropped. 


QSY 


16 


AutomaticCompletion 


Whenever a packet is inserted into a queue (from the 
PMM or from the SPU), the Complete bit is 
automatically asserted. 


17 


QueueAlwaysO 


When a packet is inserted (from any source), the 
queue will always be queue number 0. 


CMU 


24 


DummyReplyFromQSY 


Whenever the CMU receives from the SPU a 
command to the QSY that needs a response back, the 
CMU generates a dummy response and does not send 
the command to the QSY. 

The data associated to the dummy response is 0, and 
the context number is the same as the one obtained 
from the SPU. 


25 


DumntyReplyFromPMM 


Whenever the CMU receives from the SPU a 
command to the QSY that needs a response back, the 
CMU generates a dummy response and does not send 
the command to the QSY. 

The data associated to the dummy response is 0, and 
the context number is the same as the one obtained 
from the SPU. 
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Architecture block name 


Hardware block name 


IB 


rouo 


OB 


OBU0 


PMMU 


PMMO 


LPM 


LPMO 


OS 


OSY0 


RTU 


RTUO 


CU 


CUO 
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signals are registered by source block unless otherwise specified. 



Name 


Size 


SRC 
Block 


DST 
Block 


Description 


Interrupts 


overflowStarted 


1 


pmmO 


excO 


The PMM block decides to store the 
incoming packet into the EPM. 


noMorePagesOfXsize 


1 


pmmO 


excO 


No more virtual pages of the size indicated 
in the configuration register 
IntlfNoMoreXsizePages are available. 


automaticPacketDrop 


1 


pmmO 


excO 


The PMM block cannot store the incoming 
packet into the LPM and the overflow 
mechanism is disabled. 


packetError 


1 


pmmO 


excO 


Asserted in two cases: 
The actual packet size received from the 
external device does not match the value 
specified in the first two bytes of the 
packet data. 

Bus error detected while receiving packet 
data through the network interface or 
while downloading packet data from EPM. 


lessThanXpacketldEntri 
es 


1 


qsyO 


excO 


Asserted when the actual number of 
available entries in the QSY block is less 
than the value in the configuration register 
IntlfLessThanXpackettdEntries. 


packetAvailableButNoC 
ontextP 


8 

0..7) 


rtuO 


excO 


Asserted when a packet identifier is 
received by the RTU from the QSY but 
there is no available context The level of 
the interrupt (P) depends on how the PMU 
is configured. 


Response Generation 


validResponse 


1 


cmuO 


comO 


The CMU has a valid response. 


responseData 


29 


cmuO 


comO 


The response data. 


responseContext 


3 


cmuO 


comO A 


The context number to which the response 
will go. 


Context Access 


resetContext 


1 


rtuO 


rgfl),rgf 
1 


AH GPR registers in context number 
contextNumber are set to 0. 


enableRead0..7 


8x1 


rtuO 


rgfD,rgf 
1 


Read port 0..7 of context number 
contextNumber is enabled. 


enabIeWriteO.,3 


4x1 


rtuO 


rgfl),rgf 
1 


Write port 0..7 of context number 
contextNumber is enabled. 


contextNumber 


8 


rtuO 


rgfO,rgf 
1 


The context number, in 1-hot encoding 
(LSB bit corresponds to context #0; MSB 
to context #7) being either read (masked 
load or pre-load) 
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The context number, in 1 -hot encoding (LSB 
bit corresponds to context #0; MSB to context 
#7) being either read (masked load or pre-load) 
or written (masked store). 
The contextNumber bus needs to have the 
correct value at least one cycle before the first 
enableRead or enable Write signals, and it 
needs to be de-asserted at least one cycle 
before the last enableRead or enable Write 
signals* 


registerToRead 
0..7 


8x5 


rtuO 


rgfO,rgfl 


Index of the registers) to read through read 
ports 0..7 in context number contextNumber. 
Validated with the enableReadO.J signals. 


registerToWrite 
0.3 


4x5 


rtuO 


rgfl),rgfl 


Index of the registers) to write through write 
ports 0..3 in context number contextNumber. 
Validated with the enableWrite0..3 signals. 


clusterOreadDat 
a0..7 


8x32 


rgfO,rg 
fl 


rtuO 


The contents of the registers) read through 
read ports 0..7 in cluster 0. 


clusterlreadDat 
a0./7 


8x32 


rgfO,rg 
fl 


rtuO 


The contents of the registers) read through 
read ports 0..7 in cluster 1. 


writeDataO.,3 


4x32 


rtuO 


rgfO,rgfl 


The contents of the registers) to write through 
write port(s) 0..3 into context number 
contextNumber. 


Command Request 


statePMMqueu 
e 


1 


cmuO 


disO,disl 


If asserted, it indicates that a command will be 
accepted into the PMM queue. 


stateQSYqueue 


1 


cmuO 


disO,disl 


If asserted, it indicates that a command will be 
accepted into the QSY queue. 


stateRTUqueue 


1 


cmuO 


disO,disl 


If asserted, it indicates that a command will be 
accepted into the RTU queue. 


validCommand 
ClusterO 


1 


disO 


cmuO 


The command being presented by cluster #0 is 
valid. 


validCommand 
Clusterl 


1 


disl 


cmuO 


The command being presented by cluster #1 is 
valid. 


commandConte 
xtClusterO 


2 


disO 


cmuO 


The context number within cluster #0 
associated to the command being presented by 
this cluster. 


commandConte 
xtClusterl 


2 


disl 


cmuO 


The context number within cluster #1 
associated to the command being presented by 
this cluster. 


commandType 
ClusterO 


2 


disO 


cmuO 


The type of command being presented by 
cluster #0 (0:RTU, 1:PMMU, 2:QS). 


commandType 
Clusterl 


2 


disl 


cmuO 


The type of command being presented by 
cluster #1 (0:RTU, 1 :PMMU, 2:QS). 


cornmandOpco 
deClusterO 


3 


disO 


cmuO 


The opcode of the command being presented 
by cluster #0. 


cornmandOpco 
deClusterl 


3 


disl 


cmuO 


The opcode of the command being presented 
by cluster #1. 


commandData 


46 


disO 


cmuO 


J^e command data presented by cluster #0. 
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commandDataClust 
erl 


46 


disl 


cmuO 


The command data presented by cluster #1 . 


Context Unstall 


unstallContext 


1 


rtuO 


cpOO 


The masked load/store or get context 
operation performed on context number 
unstalledContextNum has finished. In case of 
a get context operation, the misc bus contains 
the number of the selected context in the 3 
LSB bits, and the success outcome in the 
MSB bit 


preload 


1 . 


rtuO 


cpOO 


A pre-load is either going to start 
(bornContext de-asserted) or has finished 
(bornContext asserted) on context number 
unstalledContextNum. The misc bus contains 
the queue number associated to the packet 
If fiie preload starts and finishes in the same 
cycle, unstallContext, preload and 
bornContext are asserted. 


bornContext 


1 


rtuO 


cpOO 


If asserted, the operation performed on 
context number unstallContextNum is a get 
context or the end of a pre-load; otherwise it 
is a masked load/store or the beginning of a 
pre-load. 


unstallContextNum 


3 


rtuO 


cpOO 


For pre-loads (start or end) it contains the 
context number of the context selected by the 
RTU. For get context and masked 
load/stores, it contains the context number of 
the context associated to the stream that 
dispatched the command to the PMU (the 
RTU receives this context number through 
the CMU command interface). 


misc 


30 


rtuO 


cpOO 


In case of a pre-load (start or end), it contains 
the 30-bit code entry point associated to the 
queue in which the packet resides. 
In case of a get context operation, the 3 LSB 
bits contain the selected context number by 
the RTU, and the MSB bit contains the 
success bit (whether an available context was 
found). 



unstallContext 


preload 


bornContext 


Action 


0 


0 


0 


No operation 


0 


0 


1 


Never 
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0 


1 


0 


Preload starts 


0 


1 


1 


Preload ends 


1 


0 


0 


Masked Load/Store 








ends 


1 


0 


1 


GetCtx ends 


1 


1 


0 


Never 


1 


1 


1 


Preload starts and 








ends in same cycle 
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Signals are registered by source block unless otherwise specified. 



Name 


Size 


SRC 
Bloc 
k 


DST 
Block 


Description 


Network Interface In to the In-Buffer 


dataValue 


128 


nipO 


ibuO 


16B of data 


validBytes 


4 


nipO 


ibuO 


Pointer to the MSB valid byte within 
dataValue 


validData 


1 


nipO 


ibuO 


If asserted, at least one byte in dataValue 
is valid, and validBytes points to the MSB 
valid byte 


rxDevID 


1 


nipO 


ibuO 


Device ID of the transmitting device 


error 


1 


nipO 


ibuO 


Error detected in the current transaction 


endOflPacket 


1 


nipO 


ibuO 


The current transfer is the last one of the 
packet 


full 


1 


ibuO 


nipO 


The buffer in the IBU block is foil and it 
will not accept any more transfers 


Network Interface Out from the Out-Buffer 

(TBD: should the interface be duplicated for each outbound device Id ?) 


dataValue 


128 


obuO 


nopO 


16B of data 


validBytes 


4 


obuO 


nopO 


Pointer to the MSB (if pattern = 0) or to 
the LSB (if pattern — 1) valid byte in 
dataValue 


pattern 


1 


obuO 


nopO 


If pattern — 1 && valid = 0, then no 
valid bytes. If pattern = 0 && valid = 
15,. then all 16 bytes are valid 


txDevID 


1 


obuO 


nopO 


Device ID of the receiving device 


err 


1 


obuO 


nopO 


Error detected in the current transaction 


ready 


4 


nopO 


obuO 


Receiving device is ready to accept more 
data 


Overflow Interface to Memory 


dataValue 


128 


ibuO 


ovlO 


16B of data 


overflowStoreRequest 


1 


pmmO 


ovlO 


Initiate an overflow store operation 


overflowPageOffset 


16 


pmmO 


ovlO 


Offset of the 256B atomic page in the 
external packet memory 


overflowLineOffset 


4 


pmmO 


ovlO 


Offset of the first line in the atomic page 


extract 


1 


ovlO 


ibuO 


Extract the next data from the buffer in 
the IBU 


doneStore 


1 


ovlO 


pmm 
0 


The overflow operation is complete 


validBytes 


4 


ibuO 


ovlO 


Pointer to the MSB valid byte within 
dataValue 


validData 


1 


ibuO 


ovlO 


If asserted, at least one byte in dataValue 
is valid, and validBytes 



Fig. 46 



WO 03/005645 



51/55 



PCT/US02/20316 











points to the MSB valid byte 


rvDevID 


1 


ibuO 


ovlO 


Device ID of the transmitting device 


error 


1 


ibuO 


ovlO 


Error detected in the current transaction 


endOfTransaction 


1 


ibuO 


ovlO 


The current transfer is the last one of the 
transaction 


packetSizeMismatch 


1 


ovlO 


pmmO 


The SIU detects a packet size mismatch 
while overflowing a packet. 


Overflow Interface from Memory 


dataValue 


128 


ovlO 


obuO 


16B of data 


validBytes 


4 


ovlO 


obuO 


Pointer to the MSB (if pattern = 0) or to 
the LSB (if pattern = 1) valid byte in 
dataValue 


pattern 


1 


ovlO 


obuO 


If pattern = 1 && valid = 0, then no 
valid bytes. If pattern = 0 && valid = 
15, then all 16 bytes are valid 


overflowRetrieveRequ 
est 


1 


pmmO 


ovlO 


Initiate an overflow retrieve operation 


overflowPageOffset 


16 


pmmO 


ovlO 


Offset of the 256B atomic page in the 
external packet memory 


overflowLineOflfset 


4 


pmmO 


ovlO 


Offset of the first line in the atomic page 
to be used 


sizePointer 


4 


pmmO 


ovlO 


Offset of the byte in the line that contains 
the LSB byte of the size of the packet 


doneRetrieve 


1 


ovlO 


pmmO 


The overflow operation is complete 


MIO 


1 


obuO 


ovlO 


The buffer in the OBU block associated to 
outbound device identifier 0 is full 


fulll 


1 


obuO 


ovlO 


The buffer in the OBU block associated to 
outbound device identifier 1 is Ml 


error 


1 


ovlO 


obu0,p 
mmO 


Error detected on the bus as packet was 
being transferred to outbound device 
identifier txDevID 


txDevID 


1 


pmmO 


ovlO 


The outbound device identifier 


Local Packet Memory Interface (SPU) 


dataValue 


128 


lmcO 


lpmO 


16Bofdata 


dataValue 


128 


lpmO 


lmcO 


16Bofdata 


read 


1 


lmcO 


lpmO 


Read request. If read is asserted, write 
should be de-asserted 


write 


1 


lmcO 


lpmO 


Write request. If write is asserted, read 
should be de-asserted. When write is 
asserted, the data to be written should be 
available in dataValue 


dataControlSelect 


1 


lmcO 


lpmO 


If asserted, it validates the read or 
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write access 


lineAddress 


14 


lmcO 


IpmO 


Line number within the LPM to read or write 


valid 


1 


lpmO 


lmcO 


Access to the memory DOrt (for read or write^ 
is granted 


Local Packet Memory/Memory Bus Interface (R 


TU) 


dataValue 


128 


lmcO 


rtuO 


16B of data 


dataValue 


128 


rtuO 


lmcO 


16B of data 


read 


1 


rtuO 


lmcO 


Read request Asserted once (numLines has 
the total number of 16-hvte linm to read^ 


write 


1 


rtuO 


lmcO 


Write reauest Asserted on a ner-Hne ha^iQ 
When asserted, dataValue from RTU should 
have data to be written 


lineAddress 


14/32 


rtuO 


lmcO 


Line to initiate access from or to 


numLines 


4 


rtuO 


lmcO 


i^uiiiu&i sJk unco i\j ivitvl. 11 liUlILLflllCo yVj 

then X+l lines are requested 


valid 


1 


lmcO 


rtuO 


Access to the operation is granted 


backgndStream 


1 


rtuO 


lmcO 


Background operation implying only the 14 
lod Diis oi inc ime au oress are useu, or 
streaming operation implying all 32 bits are 
used 


byteEnables 


16 


rtuO 


lmcO 


Byte enables. Used only for writing. For 
reading, byteEnables are OxFFFF (i.e. all 
bytes within the all the requested lines are 
read) 


SPU Command Interface through the CMU 


read 


1 


lmcO 


cmuO 


Read request If read is asserted, write should 
be de-asserted 


write 


1 


lmcO 


cmuO 


Write request If write is asserted, read 
should be de-asserted 


dataValue 


32 


lmcO 


cmuO 


4B of data 


dataValue 


32 


cmuO 


lmcO 


4B of data 


dataControlSelect 


1 


lmcO 


cmuO 


If de-asserted, it validates the read or write 
access 


lineAddress 


7 


lmcO 


cmuO 


Address of the configuration register 


valid 


1 


cmuO 


lmcO 


CMU notifies that dataValue is ready 


Performance Counters Interface through the Ci 


MU 


eventA 


6 


???? 


cmuO 


One of the two events (A) requested to be 
monitored 


eventB 


6 


rm 


cmuO 


One of the two events (B) requested to be 
monitored 


eventOataA 


16 


cmuO 


???? 


The data associated to event A, if any. This 
value is meaningful when the corresponding 
bit in the eventVector is asserted. 
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eventDataB 


16 


cmuO 


???? 


The data associated to event 
B, if any. This value is 
meaningful when the 
corresponding bit in the 
eventVector is asserted. 


eventVector 


64 


cmuO 


???? 


The event vector (1 bit per 
event). LSB bit corresponds 
to event# 0, MSB bit 
corresponds to event# 63. 


On -Chip Instrumentation (OCT) Interface through the CMU 


(TBD) 
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